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Preface 


The  purpose  of  this  study  was  to  investigate  the  trade-off  between  the  number 
of  quantization  levels  and  the  resulting  quantization  noise  characteristics  for  three 
classes  of  commonly  occurring  signals.  Prior  efforts,  particularly  those  addressing 
the  related  frequency  spectra,  had  been  primarily  limited  to  the  result  of  quantizing 
Gaussian  signals. 

Theoretical  expressio  .s  were  developed  in  terms  of  appropriate  orthogonal 
polynomials.  These  expressions  were  used  to  determine  specific  noise  characteris¬ 
tics  resulting  from  l'  e  quantization  process  over  various  numbers  of  bits. 
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Abstract 

The  purpose  of  this  study  was  to  investigate  the  trade-off  between  the  num¬ 
ber  of  quantization  levels  -tnd  the  resulting  noise  characteristics  for  three  classes 
of  commonly  occurring  input  signals,  namely,  those  signals  possessing  Gaussian, 
negative-exponential  and  random  sinusoidal  distributions. 

From  a  literature  review,  it  was  noted  that  much  had  been  done  to  characterize 
the  mean-squared  error  resulting  from  the  quantization  of  a  variety  of  input  signal 
types.  However,  those  efforts  to  characterize  frequency  spectra  had  been  limited  to 
the  output  spectrum  resulting  from  an  input  with  a  Gaussian  distribution.  This 
study  was  able  to  characterize  the  mean-squared  error,  output  spectrum  and  error 
spectrum  for  each  of  the  three  input  signal  classes  considered. 

This  study  derived  expressions  for  each  of  the  entities  under  consideration  by 
expanding  the  nonlinear  quantization  function  into  a  summation  of  orthogonal  poly¬ 
nomials  matched  to  che  corresponding  input  signal  distribution.  Once  accomplished, 
orthogonality  properties  were  applied  to  provide  usable  expressions  patterned  as 
sums  of  intermodulation  coefficients. 

A  set  of  three  Fortran  77  programs  were  developed  -  each  of  which  applied 
to  one  of  the  studied  input  signal  classes.  Each  program  required  the  quantization 
step  size,  one  appropriate  input  signal  parameter  and  the  number  of  bits  used  in  the 
quantization  process.  When  provided  each  of  these  required  values,  the  appropriate 
program  produced  upon  demand  either  a  mean-squared  error  value  and  a  signal- to- 
quantization  noise  ratio  or  quantizer  output  spectrum  data  and  quantization  error 
spectrum  data.  Typical  input  power  spectral  densities  were  applied  in  order  to 
produce  the  spectra  data. 

The  study  resulted  in  a  set  of  tables  which  provided  mean-squared  error  and 
signal- to-quantization  noise  ratio  data  based  on  various  numbers  of  bits  used  for 


x 


the  quantization  process.  Also,  a  number  of  plots  displaying  the  power  spectral 
densities  under  consideration  were  produced  as  based  on  similar  numbers  of  bits. 
Among  the  recommendations  provided  is  to  extend  the  results  of  this  thesis  to  include 
the  effects  of  non-uniform  quantization,  since  this  thesis  strictly  considered  uniform 
quantization. 
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QUANTIZATION  NOISE  CHARACTERISTICS  RESULTING 
FROM  GAUSSIAN,  NEGATIVE-EXPONENTIAL, 

AND  SINUSOIDAL  RANDOM  INPUT  SIGNALS 


I.  Introduction 


1.1  Background, 

It  is  commonly  known  that  a  quantized  signal  has  undergone  an  irreversible 
process.  The  mapping  of  a  signal  with  a  continuous  amplitude  distribution  to  a 
signal  with  a  discrete  amplitude  distribution  introduces  error  which  is  referred  to  as 
quantization  noise.  This  mapping  is  a  nonlinear  function  and  must  be  appropriately 
analyzed  for  its  introduction  of  noise. 

The  noise  which  results  from  the  quantization  process  affects  the  quality  of 
the  received  signal.  The  number  of  discrete  levels  used  in  the  quantization  process 
has  a  direct  bearing  on  the  resulting  quantization  noise.  As  this  number  of  levels  is 
allowed  to  increase  without  bound,  the  quantization  process  becomes  a  one-to-one 
correspondence,  and  the  resulting  quantization  noise  disappears. 

Perhaps  the  obvious  answer  to  the  quantization  noise  problem  is  to  increase  the 
number  of  quantization  levels  to  an  arbitrarily  chosen  large  number.  Unfortunately, 
such  a  solution  would  cause  the  cost  and  complexity  of  the  necessary  equipment  to 
increase.  In  addition,  as  more  levels  are  used,  a  larger  bit  transmittal  rate  becomes 
necessary  in  order  to  transmit  the  quantized  information. 

As  the  minimum  number  of  necessary  quantization  levels  is  determined  by 
considering  the  maximum  allowable  quantization  noise,  another  complication  arises. 
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Quantization  does  not  identically  affect  different  types  of  signals.  The  characteris¬ 
tics  of  the  quantization  noise  depend  heavily  upon  the  characteristics  of  the  input 
signal.  For  example,  an  input  signal  with  an  amplitude  distribution  evenly  spread 
throughout  the  domain  of  the  quantization  function  will  result  in  quantization  noise 
with  different  characteristics  than  that  noise  resulting  from  an  input  signal  with  a 
Gaussian  amplitude  distribution. 

In  order  to  prudently  select  the  number  of  quantization  levels  to  use  for  a  given 
application,  it  becomes  necessary  to  anticipate  the  characteristics  of  the  quantization 
noise.  Therefore,  it  is  imperative  that  a  relationship  be  developed  between  the 
imber  of  quantization  levels  and  the  resulting  noise  characteristics  for  a  given  set  of 
input  signal  amplitude  distributions.  The  noise  characteristics  warranting  particular 
interest  are  the  mean-squared  error  (also  known  as  and  referred  to  as  the  normalized 
noise  power)  and  the  noise  frequency  spectrum.  The  quantizer  output  frequency 
spectrum  also  deserves  consideration. 

1.2  Problem 

For  three  classes  of  input  signals,  this  thesis  effort  has  developed  a  relation¬ 
ship  between  the  number  of  quantization  levels  and  the  resulting  quantization  noise 
characteristics. 

1.3  Summary  of  Current  Knowledge 

There  have  been  a  number  of  prior  studies  involving  quantization  noise.  Some 
of  these  efforts  have  included  the  numerical  calculation  of  the  mean-squared  error 
for  a  variety  of  input  signal  classes.  Other  efforts  concentrated  on  the  quantization 
noise  spectra,  but  were  typically  limited  in  scope  to  the  result  of  an  input  with  a 
Gaussian  amplitude  distribution.  For  a  historical  survey  of  past  efforts,  the  reader 
is  referred  to  Chapter  II. 
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1.4  Assumptions 

In  order  to  proceed  with  this  thesis  effort,  some  assumptions  were  necessary. 
They  were  as  follows: 

1.  The  quantization  process  was  assumed  to  be  performed  by  an  ideal  quantizer, 
or  a  quantizer  which  introduces  no  nonlinearities  to  the  quantization  process 
other  than  the  intended  nonlinear  quantization  function.  The  consideration  of 
a  quantizer  perturbed  by  the  introduction  of  any  additional  nonlinearity  was 
beyond  the  scope  of  this  thesis. 

2.  The  input  signal  was  assumed  to  be  free  of  noise.  This  assumption  was  made 
in  order  to  concentrate  exclusively  on  quantization  noise. 

3.  The  input  signal  was  assumed  to  be  a  wide-sense  stationary  random  process. 
This  has  been  a  standard  assumption  when  analyzing  in  the  frequency  domain, 
since  a  random  process  possesses  a  power  spectral  density  if  it  is  wide-sense 
stationary. 

1.5  Scope 

This  thesis  was  limited  in  scope  to  the  analysis  of  the  quantization  noise  result¬ 
ing  from  an  ideal,  un.'form,  continuous-time  quantizer.  Neither  nonuniform  quan¬ 
tization  nor  sampling  effects  have  been  considered  during  the  development  of  this 
analysis. 

Quantization  noise  has  been  denoted  the  topic  of  concern  for  this  thesis.  The 
other  noise  product  of  the  quantization  process,  saturation  noise,  has  not  been  con¬ 
sidered  independently  of  quantization  noise.  This  thesis  incorporates  both  types  of 
quantization  related  noise  and  does  not  distinguish  between  the  effects  of  the  two 
types.  Gray  and  Zeoli  have  produced  a  study  which  optimizes  the  trade-off  between 
these  two  results  of  the  quantization  process  (8). 
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Finally,  this  thesis  develops  the  expressions  for  the  quantization  noise  frequency 
spectrum.  However,  the  spectrum  depends  on  the  spectrum  of  the  input  signal.  In 
order  to  produce  output  and  error  spectrums  based  on  the  derived  equations,  it 
was  necessary  to  consider  a  single  input  autocorrelation  function  for  each  class  of 
input  signals.  However,  it  should  be  noted  that  for  any  given  input  autocorrelation 
function,  the  derived  equations  may  be  difficult,  if  not  impossible,  to  apply. 

1.6  Approach 

The  approach  of  this  thesis  effort  began  by  expressing  the  autocorrelation 
function  of  the  quantization  error  in  terms  of  various  characteristics  of  the  quantizer 
input  and  output.  Those  terms  which  included  the  quantizer  output  were  then 
treated  individually  by  expressing  the  output  as  a  nonlinear  function  of  the  input. 

The  treatment  of  the  nonlinear  function  was  dependent  upon  the  amplitude 
distribution  of  the  input  signal.  For  each  of  the  three  classes  of  inputs  considered,  the 
nonlinear  function  was  series-expanded  using  expansion  techniques  derived  by  Bar¬ 
rett  and  Lampard  (2).  Once  these  series  expansions  were  complete,  the  Fourier  trans¬ 
form  of  the  resulting  autocorrelation  function  was  determined.  The  result  yielded 
a  quantization  noise  spectrum  and  a  quantizer  output  spectrum  for  each  class  of 
inputs  considered. 

Algorithms  for  determining  the  quantization  mean-squared  error,  the  quantizer 
output  spectrum  and  the  quantization  error  spectrum  were  developed  by  applying 
the  derived  equations.  Since  the  required  approach  was  dependent  upon  the  class 
of  input  signal,  multiple  algorithms  were  necessary.  The  algorithms  pertaining  to 
the  Gaussian  and  the  negative-exponential  distributed  inputs  were  based  on  basic 
orthogonal  polynomial  identities  as  determined  by  Szego  (16).  Each  algorithms  were 
then  coded  in  the  Fortran  77  computer  language  and  executed  to  obtain  the  desired 
mean-squared  error  values  and  quantization  related  spectra  for  a  variety  of  numbers 
of  quantization  levels. 


4 


Finally,  it  should  be  noted  that  the  sections  of  this  thesis  which  consider  the 
Gaussian  distributed  input  tend  to  parallel  Velichkin’s  earlier  work  (18)  and  provide 
similar  results.  This  effort  provides  an  additional  analysis  involving  the  quantization 
noise  spectrum.  In  addition,  the  sections  which  pertain  to  the  other  two  classes  of 
inputs  provide  entirely  new  material  and  new  results. 

1.7  Equipment 

An  ELXSI  mainframe  computer  with  a  UNIX  operating  system  and  a  For¬ 
tran  77  compiler  was  used  to  execute  the  computer  programs  developed  under  this 
thesis  effort. 
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II.  Historical  Survey 


Quantization  has  been  a  familiar  topic  in  the  digital  communication  field  for 
a  number  of  years.  As  a  result,  quantization  mean-squared  error  derivations  have 
appeared  in  many  reputable  textbooks  on  the  subject  matter.  This  resulting  mean- 
squared  error  represented  the  quantization  noise  power 


j\r  =  — 
1Vq  12 


(1) 


where  q  is  the  quantization  step  size  of  the  quantizer,  or  the  distance  between  quan¬ 
tization  levels.  Roden  has  provided  the  usual  treatment  (14:119-121). 

This  popular  result  has  been  based  the  assumption  that  the  quantization  error 
was  uniformly  distributed  over  its  range.  Unfortunately,  this  assumption  has  rarely 
applied  to  anything  other  than  a  classroom  problem.  However,  this  simple  expression 
generally  gave  a  good  starting  point. 


2.1  The  Gaussian  Distributed  Input 

Probably  the  most  obvious  class  of  inputs  to  be  considered  was  that  class  pos¬ 
sessing  a  Gaussian  probability  density  function.  Many  types  of  signals  and  noise 
possess  an  amplitude  probability  density  which  very  closely  resembles  such  a  func¬ 
tion. 

Max  sought  to  develop  an  algorithm  which  would  determine  the  necessary 
quantization  parameters  to  minimize  distortion  for  both  uniformly  and  Gaussian 
distributed  inputs.  His  approach  was  to  minimize  the  expected  value  of  some  function 
of  the  quantization  error.  He  chose  this  function  to  be  the  square  of  the  quantization 
error.  Consequently,  the  mean-squared  error  became  the  value  to  be  minimized 
(11:7-9). 
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Max  considered  both  nonuniform  and  uniform  quantization.  In  the  nonuniform 
case,  he  partially  differentiated  his  expression  for  the  mean-squared  error  with  respect 
to  both  the  input  and  the  output.  Next,  he  equated  both  results  to  zero.  He  then 
employed  iterative  numerical  techniques  in  order  to  solve  these  resulting  equations 
and  yield  quantizer  outputs  and  corresponding  ranges  of  inputs.  The  matching  of 
these  outputs  to  ranges  of  inputs  provided  the  minimum  possible  mean-squared  error 
for  a  given  number  of  quantization  levels  (11:8-9). 

Similarly,  Max  applied  his  optimization  techniques  to  the  uniform  quantization 
case.  He  partially  differentiated  his  expression  for  the  mean-squared  error  with 
respect  to  the  uniform  step  size.  Once  again,  he  equated  the  result  to  zero.  However, 
this  time  he  employed  iterative  numerical  techniques  in  order  to  yield  the  optimal 
step  size.  This  step  size  would  provide  the  minimum  mean-squared  error  for  a  given 
number  of  levels  (11:9). 

The  results  for  both  the  nonuniform  and  uniform  quantization  case  were  pre¬ 
sented  in  tabular  form  for  the  number  of  output  levels  ranging  from  1  to  36.  In  each 
case,  the  resulting  mean-squared  error  was  also  determined  and  given  (11:11-12). 

2.2  The  Rayleigh  Distributed  Input 

As  image  processing  and  optical  holography  research  became  more  common, 
the  Rayleigh  probability  density  function  became  more  applicable  to  the  quantization 
process.  Pearlman  and  Senge  recognized  this  trend  and  adapted  Max’s  algorithm  to 
determine  the  optimal  quantization  of  an  input  possessing  a  Rayleigh  distribution 
(12:101). 

Pearlman  and  Senge  inserted  the  Rayleigh  probability  density  function  into 
the  equation  for  the  mean-squared  error.  As  Max  had  done,  they  also  considered 
both  nonuniform  and  uniform  quantization.  In  both  cases,  partial  differentiations 
were  taken  and  equated  to  zero.  Iterative  Newton-Raphson  techniques  were  used  in 
both  cases  to  determine  the  optimal  step  sizes.  Also,  in  both  cases,  least-squares 
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curve  fitting  techniques  were  also  applied  to  yield  general  approximation  equations 
for  the  mean-squared  error  as  a  function  of  the  number  of  quantization  levels  (under 
optimal  quantization  conditions)  (12:102-103). 

The  effort  was  completed  with  the  inclusion  of  tables  providing  the  optimal 
step  sizes,  resulting  mean-squared  error,  and  output  entropy  for  the  number  of  quan¬ 
tization  levels  ranging  from  2  to  64  (12:104-111). 

2.3  A  Wider  Class  of  Inputs 

As  applications  to  the  quantization  process  have  increased,  a  wider  class  of 
inputs  have  become  applicable.  Lu  and  Wise  applied  techniques  similar  to  those 
used  by  Max  and  by  Pearlman  and  Senge  to  four  input  distributions:  Gaussian, 
two-sided  Rayleigh,  Laplace,  and  two-sided  gamma.  Each  of  these  considered  dis¬ 
tributions  were  two-sided  and  symmetrical  (unlike  the  classic  Rayleigh  distribution 
considered  by  Pearlman  and  Senge).  However,  Lu  and  Wise  considered  only  uniform 
quantization  (10:471-472). 

Lu  and  W.„.e  were  determined  to  avoid  the  massive  tables  provided  by  earlier 
investigators  of  the  topic.  Therefore,  one  of  their  prime  objectives  was  to  provide 
approximation  techniques  in  a  compact  form.  In  order  to  do  so,  they  applied  curve 
fitting  techniques  to  each  of  their  results  so  that  only  a  short  list  of  parameters  would 
require  tabulation.  These  parameters  could  then  be  used  to  approximate  th^  optimal 
step  size  and  the  resulting  mean-squared  error  for  any  number  of  quantization  levels 
ranging  from  4  to  1024.  Their  final  results,  spanning  four  different  input  distributions 
and  the  above  range  of  numbers  of  levels,  were  then  able  to  fit  in  three  small  tables 
(10:472-473). 

2.4  The  Frequency  Spectrum  of  the  Output 

The  previously  acknowledged  efforts  were  each  limited  in  scope  to  the  con¬ 
sideration  of  the  mean-squared  quantization  eiror,  or  the  quantization  noise  power. 
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However,  the  distribution  of  this  power  across  the  frequency  spectrum  could  be  just 
as  important,  depending  upon  the  particular  application. 

2. 4-1  Early  Work  When  the  quantization  of  speech  signals  emerged,  Bennett 
became  one  of  the  first  to  successfully  characterize  the  spectrum  of  a  quantized 
signal.  Bennett  restricted  his  consideration  to  input  signals  possessing  a  Gaussian 
distribution  (3;4G3). 

Li  the  interest  of  examining  the  frequency  spectrum,  Bennett  understood  the 
importance  of  characterizing  the  autocorrelation  function  of  the  quantization  error. 
He  derived  an  approximation  of  such  a  characterization  by  employing  classical  prob¬ 
ability  density  function  transformation  techniques  and  by  applying  Poisson’s  sum¬ 
mation  formula.  The  result  was  an  autocorrelation  function  of  quantization  errors  in 
terms  of  the  autocorrelation  function  of  the  signal.  The  Wiener-Khinchine  Theorem 
was  then  applied  to  provide  an  error  power  spectral  density  formula  (3:463-468). 

When  Bennett  examined  the  complete  spectrum  of  the  result  of  the  quantiza¬ 
tion  process,  it  became  necessary  for  him  to  also  consider  the  effects  of  sampling  the 
original  analog  signal.  While  this  inclusion  tended  to  create  some  confusion  regard¬ 
ing  the  effects  of  only  the  quantization  process,  it  did  provide  an  understanding  of 
the  effects  of  increased  sampling  frequency  on  the  signal- to-quantization  noise  ratio 
for  a  given  number  of  bits  (3:453). 

2.4.2  Other  Approaches  As  the  quantization  operation  became  more  com¬ 
monplace,  Velichldn  also  sought  to  characterize  the  spectrum  of  the  output  of  a 
quantizer.  He  also  limited  himself  to  a  Gaussian  distributed  input.  However,  unlike 
Bennett,  Velichkin  chose  to  consider  the  efFects  of  sampling  and  quantization  inde¬ 
pendently.  This  modularized  his  efforts  and  allowed  him  to  examine  the  efFects  of 
quantization  apart  from  those  of  the  sampling  process  (18:70). 

Velichkin  used  orthogonal  polynomial  expansion  for  the  second-order  Gaussian 
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probability  distribution  to  obtain  an  exact,  but  computationally  intensive  equation 
for  the  autocorv Nation  function  for  the  output  of  the  quantizer.  Once  again,  the 
Wiener-Rninchine  theorem  was  applied  to  result  in  the  power  spectrum  of  the  quan¬ 
tizer  output  (18:71-73). 

Lever  was  interested  in  comparing  the  results  of  Bennett,  Velichkin,  and  other 
notable  quantization  noise  spectrum  efforts  made  over  the  years.  Like  Bennett,  Lever 
chose  to  analyze  the  effects  of  sampling  and  quantization  jointly,  but  did  so  with  a 
sensitivity  to  prior  work  which  separated  the  effects  of  the  two  processes  (9:201-203). 

Lever  was  also  able  to  compare  theoretical  and  experimental  signal-to-noise 
ratio  results.  He  did  so  under  two  different  circumstances.  First,  he  considered  the 
effects  of  an  ideal  quantizer.  Next,  he  considered  the  effects  of  a  quantizer  which 
had  been  perturbed  by  the  introduction  of  an  additional  nonlinearity.  He  was  able 
to  show  that  developed  theoretical  relationships  were  inadequate  to  provide  accurate 
estimates  when  the  quantization  process  was  perturbed  by  an  additional  nonlinearity 
(9:203-206). 

2.5  Closing  Comments  Regarding  Previous  Efforts 

There  have  been  a  number  of  studies  performed  in  the  area  of  quantization 
noise.  They  have  included  the  minimization  of  quantization  noise  for  a  variety  of 
inputs.  These  noise  minimization  studies  have  often  considered  nonuniform,  as  well 
as  uniform  quantization.  There  have  also  been  efforts  made  in  the  interest  of  charac¬ 
terizing  the  quantization  noise  spectrum.  These  efforts  have  typically  been  limited 
to  Gaussian  inputs  undergoing  uniform  quantization.  A  matrix  of  the  discussed  prior 
studies  and  their  applicability  to  the  different  input  distributions  and  quantization 
types  appears  in  Table  1. 

There  exists  a  relationship  between  this  thesis  and  these  past  efforts.  This 
thesis  effort  has  developed  quantization  noise  spectrum  expressions  resulting  from 
Gaussian  inputs,  as  well  as  two  other  classes  of  inputs.  Some  of  the  techniques  used 
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Table  1.  Prior  Study  Applicability  Matrix 


Input  Distributions 

Quantization  Type 

Gaussian 

Rayleigh 

Others 

Uniform 

Nonuniform 

Mean-Squared  Error 

Max 

X 

X 

X 

Pearlman  and  Senge 

X 

X 

X 

Lu  and  Wise 

X 

Two-Sided 

X 

X 

Error  Spectrum 

Bennett 

X 

X 

Velichkin 

X 

X 

Lever 

X 

X 

to  develop  these  derivations  were  similar  to  those  used  in  the  prior  quantization 
noise  spectrum  efforts.  As  already  noted  in  Chapter  I,  the  thesis  effort  regarding  the 
Gaussian  input  specifically  tended  to  parallel  Velichkin's  efforts  (18)  and  provided 
similar  results.  The  prior  noise  minimization  studies  were  also  useful  as  a  comparison 
tool  against  the  calculations  resulting  from  the  derived  mean-squared  error  equations. 


III.  Theoretical  Development 


3.1  The  Quantization  Process 

In  order  to  appropriately  study  the  effects  of  quantization,  the  quantization 
process  itself  must  be  understood  on  a  basic  level.  Let  the  time-varying  input  to 
the  quantizer  is  denoted  as  x(t)  and  the  output  is  denoted  as  y(t).  If  g(x)  can  be 
determined  such  that  y(t )  =  or  y  =  g(x)>  the  relationship  between  y(t)  and 

x (t)  for  an  ordinary  Q-bit  uniform  quantizer  with  a  step  size  of  q  and  for  Q  —  4  bits 
is  as  illustrated  in  Figure  1. 

For  a  Q-bit  quantizer,  there  are  2^  distinct  levels  with  a  step  size  of  q  between 
each  level.  Consequently,  the  normal  operating  region  of  the  quantizer  exists  over  a 
range  of  q(2Q  —  1).  As  a  result,  the  relationship  illustrated  in  Figure  1  exists  over 
a  range  of  x(t)  from  -\q{2Q  -  1)  to  +f<7(2Q  -  1).  Beyond  this  range  of  x(t),  the 
quantizer  will  simply  output  a  level  corresponding  to  dh|?(2<?  - 1)  depending  on  the 
sign  of  the  input.  This  phenomenon  is  known  as  saturation  and  ±|g(2^  —  l)  are 
denoted  the  saturation  levels  of  the  quantizer. 

3.2  Quantization  Error 

3.2.1  Defining  the  Quantization  Error  The  error  resulting  from  tne  quantiza¬ 
tion  process  is  known  as  the  quantization  error  and  can  be  determined  as  a  function 
of  time  by  the  equation 

eq(t)  =  y{t)  -  x(t)  (2) 

where  once  again,  x(t)  and  y(t)  are  the  quantizer  input  and  output,  respectively. 
The  quantizer  error  only  exists  over  the  normal  operating  range  of  the  quantizer. 

For  \x(t)\  >  \q{2Q  —  l)  saturation  error  results.  It  can  also  be  determined 
by  Equation  2.  The  analysis  in  this  thesis  incorporates  both  types  of  quantization 
related  error,  and  does  not  distinguish  between  the  effects  of  the  two. 
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3.2.2  The  General  Quantization  Noise  Autocorrelation  Problem 

3.2.2. 1  The  Preliminary  Expression  In  order  to  determine  the  power 
or  the  spectrum  of  the  quantization  noise,  x(t ),  y(t )  and  eq(i)  must  be  considered 
as  random  processes.  As  random  processes,  these  functions  will  be  denoted  as  X(t), 
Y(t )  and  Eq(t ),  respectively.  In  addition,  these  random  processes  are  assumed  to 
be  stationary  in  the  wide  sense,  implying  that  the  mean  of  the  random  process  is 
constant  and  its  autocorrelation  is  a  function  of  time  differential. 

The  initial  goal  is  to  obtain  the  autocorrelation  of  the  error,  defined  as 

re,{t) = e  mmw  (3) 

where  r  =  t^  — 1\,  and  I?  is  the  expectation  operator. 
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Equation  3  becomes 


REq(r)  =  ^{^(iO-^iOHK^)-^)]} 

=  ElYitJYih)  -XitJYfa)  ~  YWXM  +  XMXfo)] 

«  E  [Y(h)Y(h)}  -  E  [X(U )Y(h)}  -  E  {Y(h)X(t2)] 

+  E[X(h)X(h)} 

=  Ry{t)  ~  Rxy(t)  -  Ryx(t)  +  Rx(t)  (4) 

where  Rxy(t)  is  the  crosscorrelation  function  defined  as 

RXY(T)*E[X(U)Y(t2)]  (5) 

If  Y(t)  can  be  determined  as  a  function  of  X(t ),  or  if  g(x)  can  be  determined 
such  that  y  =  g(x),  then  the  autocorrelation  definition  can  be  used  to  yield 

/co  r  co 

/  g(xi)g(xt)W(xiixrfr)dxidx2  (6) 

-oo  J— oo 

where  xi  =  x(ti),  an  observation  of  the  random  variable  X(ti).  Similarly,  x2  =  x(t2). 
Also,  W(x iyx2\ r)  is  the  joint  probability  density  function  applicable  to  X(t)  for  the 
bivariate  case. 

The  second  and  third  terms  appearing  in  Equation  4  require  more  advanced 
treatment.  Bussgang  proved  that  if  an  input  possesses  a  Gaussian  distributed  am¬ 
plitude,  the  crosscorrelation  of  the  input  and  output  of  a  distorting  device  “will  be 
proportional  to  the  autocorrelation  of  the  input  signal”  (4:5).  Barrett  and  Lampard 
broadened  the  scope  of  Bussgang’s  important  theorem  to  include  the  distributions 
discussed  in  this  thesis  (2).  They  also  provided  the  expression  to  determine  the 
constant  satisfying 

Rxy(t  )  =  cRx  (r )  (7) 
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as 


C  =  /  oo  flr(®2)W'2(®2)  <**2  (8) 

where  W2(x2)  is  the  marginal  probability  density  function  applicable  to  X(t2),  and 
(i2  and  a\  are  the  mean  and  the  variance,  respectively,  of  X(t2 )  (2:25).  It  also  follows 
from  these  results  that 

Rxy(t)  =  .Ryx(t)  (9) 

since  Rx{r)  is  an  autocorrelation  and  is,  therefore,  an  even  function. 

By  applying  Equations  4,  6,  7,  8  and  9,  the  following  general  relationship  for 
the  autocorrelation  of  the  quantization  results: 


/oo  r  co 

/  g(x1)g(x2)W(x1,x2-,T)dx1dx2 

■CO  J  —  oo 

1-2  J  ^g{x2)W2(x2)  dx2 


Rx(r)  (10) 


3.S.2.2  Treatment  of  the  Nonlinearity  Since  it  is  assumed  that  the  prob¬ 
ability  density  functions  required  to  evaluate  the  expression  given  as  Equation  10 
are  known,  the  next  obstacle  is  the  determination  of  an  appropriate  expression  for 
the  nonlinear  relationship  y  —  g(x)  so  that  the  above  integrals  can  be  evaluated. 

Thomas  provided  a  general  technique  for  treating  a  nonlinearity  which  involves 
a  series  expansion  of  the  nonlinearity.  The  expansion  can  then  be  employed  to  yield 
an  appropriate  expression  for  y  =  g(x)  (17:314-323).  However,  Thomas’  own  utiliza¬ 
tion  of  his  technique  is  useful  only  if  the  input  possesses  an  amplitude  distribution 
which  is  Gaussian.  The  general  technique,  as  applied  to  the  quantization  problem, 
is  as  outlined  in  the  following  paragraphs. 

The  nonlinear  function,  g(x),  can  be  represented  by  the  series 

CO 

g{x)  =  £  cnV’n(x)  (11) 

«=0 
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where  4'n(x)  are  orthonormal  polynomials  with  respect  to  the  marginal  probability 
density  function,  W(:c).  This  implies  that 


/CO 

W(x)ipm(x)if)n(x)dx  =  S„ 

•CO 


is  satisfied,  where  Smn  is  the  Kronecker  delta  satisfying 


1  if  m  =  n 
0  otherwise 


(12) 


(13) 


The  equation 

/OO 

g(x)W(x)il>n(x)dx  (14) 

■CO 

is  used  to  determine  cn.  This  integral  can  become  quite  a  formidable  task  unless 
ipn(%)  is  carefully  chosen  with  regard  to  W(x). 

Since  g(x)  is  discontinuous,  the  integral  appearing  as  Equation  14  may  be 
approached  as  the  Riemann-Stieltjes  integral 

/  f{x)da(x) 

J  a 

where  f(x)  corresponds  to  g(x)  and  da(x)  corresponds  to  W(x)tpn(x)  dx.  In  addition, 
the  limits  a  and  b  correspond  to  — oo  and  oo,  respectively.  Applying  the  formula  for 
integration  by  parts  applicable  to  the  Riemann-Stieltjes  integral  (1:144)  yields 

/CO 

Fn(x)dg(x)  (15) 

•CO 

where 

d 


By  inspection  of  Figure  1 


M 


dg(x)  =  ^2  ^(x  —  iq )  dx 
i=-M 

where  M  =  2<5-1  —  1  and  is  the  Dirac  delta  function  which  satisfies 


(17) 


<$(2)  =  liniTrrexp 
v  '  b-+o\b\  V 


■'(! 


'\2' 


(18) 


(6:50).  Consequently,  the  sampling  property  of  this  delta  function  can  be  determined 
as 


1 

(X\* 

Lirxp 

— 7T  | 

Kb)  . 

f(x)  dx 


=  m 


(19) 


for  any  continuous  function,  f(x).  Therefore,  inserting  Equation  17  into  Equation  15 
yields 

[■00  M 

cn  =  \g{x)Fn(x)}  1^-/  J2  qS{x  -  iq)Fn(x)  dx  (20) 

i=-M 

Some  rearrangement  and  the  use  of  the  sampling  property  determined  as  Equation  19 
provides  the  following  identity: 


M 


Cn  =  [tf(z)i;’n(s)]|!!co  -  J2  ?#»(*) 

i=-M 


(21) 


x=iq 


3.3  The  Gaussian  Case 

3.3.1  The  Noise  Autocorrelation  Problem  for  a  Gaussian  Input  If  the  input 
signal  level  possesses  a  Gaussian  probability  distribution,  it  becomes  necessary  to 
consider  both  the  first  and  second  order  probability  density  funotions  which  possess 
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the  following  forms  respectively: 


W(x)  = 


it  a 


■  exp 


2cr2  , 


(22) 


and 


W(xuxi\t)  = 


*l+®2-2aiS2j!>i(T)\ 

eXPt  Kl(r))  ) 


(23) 


27t<t2[1  -  p2(r)]2  1  V  2<72[1 

where  the  distributions  are  assumed  to  be  shifted  so  that  the  mean  of  X(t )  is  zero 
for  all  values  of  t.  The  variance,  <r2,  is  equivalent  to  Rx(0),  and  the  correlation 
coefficient,  px(r ),  is  equivalent  to  ,  or 

The  orthogonality  property  for  the  Hermite  polynomial  is 


-^=  J  exp  f-y)  Hm(x)H„(x)  dx  =  6m„ n\ 


(24) 


where  Hn(x)  is  the  n-th  degree  Hermite  polynomial  defined  by 


x“  \  dn 


I-In{x)  =  (-l)nexp  I  y  .  ^ 


exp  — 


ar 


(25) 


for  non-negative  integer  values  of  n  (2:27).  The  change  of  variables  mapping  x  to  f 
as  performed  on  Equation  2T  results  in 

(~2^)  Hm  (a)  Hn  {a)  dX  =  <5mnn!  (26) 

which  implies  that  a  suitable  tf)n(x)  satisfying  Equation  12  is 


(27) 


or 


(— l)n  exp 
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(28) 


d" 


exp  - 


a' 

2^ 


Inserting  the  expressions  given  as  Equations  22  and  28  into  Equation  21  pro¬ 
vides  the  following  for  n  =  1, 2, 3, . . .  : 


_  [  (-l)w<7(s)  n-i  <*"  1 
n  "  I  v&T  dx"~' 


exp  H?) 


_  £  «(=£„»-■ <f"1 


;=T^  V2?rn!  da7*"1 


exp  - 


2a2, 


x=iq 


M 


sj>xpl 


!  x 2 


2a2 


(-1)"-1  exp 


a:2  \  dn-1 


>V  <(.)- 


$(«)  /"  ®2  \  ,  lVl_i  /  a2  A  d 

:exPl -—)(-!)  exp  — 


n-1 


\/2i rn! 


2a2 


Wife) 


n-l 


exp 


exp 


x 


M 

/ _ y 


9  Eexp(-S)//„.  ^ 


2a2 


^ i* 


«© 


,V27rn!  1  \  2a2 1 

Note  that  the  second  term  vanishes  since 


2a2, 


2a2 


x—tq 

co 


(29) 


,•  P(X) 

hm - j-rr  =  0 

*-*co  exp(x2) 


(30) 


for  any  polynomial  p(®).  Therefore,  for  n  =  1,2,3, .. .  , 


M 


-vS3,5“p 


Cm  — 


M 

2a2 


)'-e 


(31) 


The  n  =  0  case  must  be  considered  separately.  For  n  =  0,  Equation  14  becomes 


/CO 

(jr(x)IF’(x)  da; 

■CO 


(32) 
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since  ?/>o(tf)  -=  1.  Now,  since  for  the  Gaussian  case,  <7(0;)  is  an  odd  function  and  W(a;) 
is  an  even  function,  the  product  g(x)W(x)  is  odd  and 


cq  =  0 


(33) 


An  important  note  regarding  the  Hermite  polynomial,  IIn(x),  is  that  if  n  is 
even,  each  term  within  Hn(x)  with  a  nonzero  coefficient  possesses  an  even  power  of 
x.  Similarly,  if  n  is  odd,  each  term  within  Hn(x )  with  a  nonzero  coefficient  possesses 
an  odd  power  of  x.  This  leads  to  the  following  observation: 


f  —Hn(x)  n  odd 
I  Hn(x)  n  even 


Applying  this  property  to  Equation  31  provides 


0 


n  odd 
n  even 


(34) 


(35) 


It  is  now  possible  to  express  the  nonlinear  function,  g(x),  in  the  series  repre¬ 
sentation 


$(*) 


_JL  y  y  _ I _ expf-fe^ 

ho  ihM  (2k  +  x)!  P  V  20-2  / 


(36) 


The  new  expression  can  now  be  applied  to  the  first  portion  of  the  REq(r) 
expression,  given  as  Equation  10,  or  equivalently  to  the  Ry(r )  expression,  given  as 
Equation  6.  But  first,  W(xi,X2\t)  must  be  treated  appropriately. 

In  order  to  simplify  the  integral  given  in  Equation  6  by  taking  advantage  of 
the  orthogonality  property  of  the  Hermite  polynomial,  W(xi,x 2;  r)  can  be  expanded 
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into  the  following  form: 


where 


ak  = 


27t(2k+l)\ 


(41) 


Now,  the  second  term  in  Equation  10  may  be  attacked  by  first  evaluating  the 
integral  given  by  Equation  8.  For  the  case  at  hand,  Equation  8  becomes 


(42) 


Noting  that  this  integrand  is  an  even  function  of  x  allows  the  use  of  the  following 
equation: 

C=^l  ^exp[-^)dx  (43) 

Ignoring  the  form  of  g(x)  derived  as  Equation  36  and  performing  the  integration  given 
as  Equation  43  as  a  finite  sum  of  integrals  over  intervals  where  g(x)  is  continuous 
yields 


Expanding  the  summation  and  collecting  terms  provides  the  following  expression: 
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(45) 
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The  autocorrelation  of  the  quantization  error  can  now  be  expressed  as  a  func¬ 
tion  of  the  autocorrelation  of  the  input  in  the  following  manner: 


RBq{r) 


+ 


M 

1  +  2  Yj  exp 

m=l 


Rx(r) 


(46) 


3.3.2  The  Determination  of  Some  Noise  Related  Figures  of  Merit  for  a  Gaus¬ 
sian  Input 


3.3.2. 1  The  Normalized  Noise  Poxoer  Once  Equation  46  has  been  pro¬ 
vided,  the  determination  of  an  expression  for  the  normalized  noise  power  becomes 
quite  trivial.  The  normalized  noise  power,  or  the  mean-squared  error,  is  merely  the 
autocorrelation  of  the  quantization  error  evaluated  at  a  time  differential  of  zero,  or 
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(47) 


3.3. 2. 2  The  Signal-to- Quantization  Noise  Ratio  Now  that  Equation  47 
has  been  provided,  asignal-to-quantization  noise  ratio  expression  also  becomes  trivial 
since  the  normalized  signal  power  in  this  case  is 


5  =  Rx(t  =  0)  =  cr2 


(48) 
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Therefore,  the  desired  ratio  then  becomes 
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m=l 


-1 


(49) 


3.3.3  The  Determination  of  ike  Quantization  Noise  Spectrum  for  a  Gaussian 
Input  Once  the  relationship  for  the  autocorrelation  of  the  quantization  error  has 
been  provided  as  :n  Equation  46,  the  quantization  error  spectrum  can  be  deter¬ 
mined  by  applj’in.,,  the  Wiener-Khinchine  relationship.  This  relationship,  given  in 
Shanmugan  and  Breipohl  (15:145),  is 


Ge,(/)  =  ^Km] 

/CO 

Re,,  (t)  exp(-j27r/r)  dr  (50) 

•CO 


where  j  =  \f-[.  In  other  words,  the  power  spectral  density  of  the  quantization  error 
is  the  Fourier  transform  of  the  applicable  autocorrelation  function. 

The  Fourier  transform  operation  is  well  known  as  being  a  linear  operation.  As 
a  result,  the  application  of  the  Wiener-Khinchine  relationship  to  Equation  46  results 
in 
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which  takes  the  form 


CO 

<?*,(/)  = 

k-0 

where  a k  is  as  defined  in  Equation  41  and 


6=1- 


M 

14  2  ^  exp 

m= 1 


(52) 


(53) 


If  an  identical  approach  is  taken  regarding  Equation  40,  the  following  relation¬ 
ship  results  for  the  output  spectrum: 

<M/)  =  f>^K'+,M]  (54) 

k= 0 

The  intermodulation  coefficients,  a^,  will  require  a  certain  amount  of  involved 
computation  -  especially  since  these  coefficients  converge  towards  zero  somewhat 
slowly  as  k  increases  without  bound.  However,  ignoring  tl  .  problem  for  the  moment, 
it  should  be  noted  that  the  evaluation  of  7  [i?^fc+1(r)]  as  k  increases  without  bound 
is  not  a  trivial  exercise  for  the  general  Rx{r). 

A  manageable  Rx(t)  with  some  application  to  communications  is 


Rx{r)  =  exp(— a|r|) 


(55) 


where  a  is  a  positive  constant  and  acts  as  a  damping  factor.  Inserting  this  input 
correlation  function  into  the  error  power  spectral  density  equation  results  in 


GEq{f)  =  {exp[— a(2fc  4  l)|r|]}  +  bT  (exp[— or|r|]} 
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Similarly, 


(67) 


oo 


Qy(f)  =  Hak 

k= 0 


2a(2/c  -f- 1) 
a2(2  k  +  1  )2  +  (2tt/)2 


3.4  The  Negative-Exponential  Case 

3.4 -1  The  Noise  Autocorrelation  Problem,  for  a  Negative-Exponential  Input 
If  a  signal  with  a  Gaussian  amplitude  distribution  undergoes  a  narrow  bandpass 
operation,  the  resulting  envelope  has  a  Rayliegh  first  order  distribution.  If  following 
the  filtering  operation,  the  signal  undergoes  a  square  law  detection  operation  which 
introduces  no  time  delay,  then  the  signal  level  of  the  output  possesses  the  second 
order  probability  density 


W(xi,X2‘,t)  = 
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No 


®o[l  -  P2(t)) 

®1  +  ®3 

•  exp 


V®i®2  p(r) 

®o  1  -pP{r) 


»o(l  -/i2(T)]J 


(58) 


for  0  <  (xi,x2)  <  co  (2:27).  The  parameter  xq  corresponds  to  the  expected  value  of 
x.  The  operation  Im(x)  is  the  m-th  order  modified  (or  hyperbolic)  Bessel  function. 
The  function  /i(r)  is  related  to  the  autocorrelation  of  -X’(i).  This  relationship,  as 
well  as  its  derivation,  appears  in  Section  A.l  of  this  thesis. 

The  resulting  first  order  probability  density  function  is  the  familiar  negative- 
exponential  density  function 


W(x)  =  < 


0  <  x  <  00 
otherwise 


(59) 


Of  particular  note  is  the  constraint  that  x  must  be  non-negative.  This  con¬ 
straint.  necessita,t,fis  a.  modification  of  the  quantization  process.  Since  x  must  be 
non-negative,  there  is  no  need  to  consider  nonlinearities  for  negative  values  of  x. 
Now,  the  appropriate  relationship  between  the  output  of  the  quantizer,  y(t),  and  the 
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Figure  2.  Non-Negative  Quantizer  Output  vs  Input  for  Q  =  4  Bits 


input,  x(t),  appears  as  in  Figure  2. 

As  before,  for  the  Q-bit  uniform  quantizer,  there  are  2^  distinct  levels  with 
a  step  size  of  q  between  each  level.  However,  now  saturation  occurs  when  x(t) 
equals  <7(2^  —  1)  4-  g(x  =  0),  or  the  largest  x(t)  which  equals  its  corresponding 
y(t).  Therefore,  now  the  operating  region  of  the  quantizer  exists  over  a  range  of 
q{2Q  -  1)  +  g(x  =  0). 

As  for  the  general  case,  the  autocorrelation  function  for  the  quantization  noise 
will  follow  the  relationship  described  in  Equation  10.  The  treatment  of  the  nonlin¬ 
earity  will  also  match  the  treatment  given  in  Equations  11  through  15.  However, 
Equation  17  now  becomes 

J-[9(x)]  =  Y,<l6(x-i(i)  (60) 

ax  {=l 
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where  N  =  2^  —  1.  As  a  result,  Equation  21  now  becomes 

c„  =  g(x)Fn(x)  |“  -  J2  ?-p,»(®)l«=f,  (61) 

i=i 

where  0„(x)  are  now  orthonormal  polynomials  with  respect  to  the  marginal  prob¬ 
ability  density  function  now  under  consideration.  As  before,  Fn{x)  is  as  defined  in 
Equation  16. 

The  orthogonality  property  for  the  Laguerre  polynomial  is 


roo 

/  e~xLm(x)Ln(x)  dx  =  S„ 
Jo 


(62) 


where  Ln(x )  is  the  n-th  degree  Laguerre  polynomial  defined  by 


(63) 


for  non-negative  integer  values  of  n  (2:28).  The  change  of  variables  mapping  x  to  — 
as  performed  on  Equation  62  results  in 
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Inserting  the  expressions  given  as  Equations  59  and  66  into  Equation  61  pro¬ 
vides  the  following  for  n  =  1, 2, 3, . . .  : 


Now,  noting  that 


provides  the  identity 


Inserting  this  identity  into  Equation  67  provides  the  following  for  n  =  1, 2, 3, . . .  : 
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where 


fl(g=°)  ,•  _ 
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i  =  0 

i  =  1,2,3, , 


(71) 


The  n  =  0  case  must  be  considered  separately.  For  n  =  0,  Equation  14  becomes 


r  oo 

Co  =  /  g(x)W(x)dx 
Jo 


(72) 


since  ipo(x)  =  1.  Therefore, 
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+  [(?(rc  =  0)  +  (N  +  l)^]  exp  \  dx 


x0 


(73) 


Expanding  and  combining  terms  yields 


-0  =  Ew?exp 

i^o  '  xo 


(74) 


Therefore,  Equation  70  also  applies  to  the  n  =  0  case  if  the  understanding  is  made 
that  the  Ln-i(x)  terms  vanish  when  n  =  0. 


It  is  now  possible  to  express  the  nonlinear  function,  g(x),  in  the  series  repre¬ 


sentation 


*(*>  -  s*£*  ©  (-5)  ^  (5)  -  ^  (2)1  (75) 

Similar  to  the  earlier  Gaussian  analysis,  the  next  step  is  to  apply  the  expression 
for  the  nonlinearity  to  the  equation  for  the  autocorrelation  of  the  quantizer  output, 
Ry(r).  But  also  as  in  the  Gaussian  analysis,  W(xi,X2\t)  must  be  expanded  in 
order  to  take  advantage  of  the  orthogonality  of  the  polynomials  used.  Barrett  and 
Lampard  (2:28)  showed  that  W(xi,X2]  r)  can  be  expanded  into  the  following  form: 


W(xi,x2 ;r)  =  ~  exp  f--1*1*2)  £  /u2m(r)lm  f—)  Ln  (— 
Xo  \  *o  J  \x0 )  \»o 


By  utilizing  Equations  75  and  76,  and  by  rearranging  the  orders  of  summation 
and  integration,  Equation  6  now  becomes 


Ry(t)  = 
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The  orthogonality  principle  given  by  Equation  64  allows  the  simplification  of 
the  previous  expression  to 


Ry(t)  =  <?2  E  E  E  {viVj  exp  (iq  n2k{r) 
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k= 0  lf=0  '  ^0'  \*0/  \®o/JJ 


which  takes  the  form 


fly  O')  =  J2  aW (T) 

k=o 


where 


1™) 


(80) 


Now,  the  other  term  in  the  error  autocorrelation  expression,  Equation  10,  may 
be  approached.  First,  the  constant,  c,  may  be  evaluated  by  performing  the  integral 
given  in  Equation  8.  For  the  applicable  probability  density  function,  Equation  8 
becomes 
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where  —  Xq.  Ignoring  the  form  of  g(x)  derived  as  Equation  75  and  performing 
the  integration  given  as  Equation  81  as  a  finite  sum  of  integrals  over  intervals  where 
g(x)  is  continuous  yields 
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(82) 


Expanding  the  summation  and  collecting  terms  provides  the  following  expression: 
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The  autocorrelation  of  the  quantization  error  can  now  be  expressed  in  the 
following  form: 

CO 

re„{t)  =  £  +  (1  -  2c) -ft a' (T)  (84) 

k= 0 

which  introduces  a  new  problem.  The  relationship  between  Rx{r)  and  /. t(r )  remains 
to  be  determined.  To  determine  this  relationship,  the  following  integral  may  be 
considered: 


nco 

xix2W(x1,x2]T)dxi 
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dx-i 


2y/XxX2  h(t) 

xo  1  -  /i2(r)_ 

(85) 

The  reduction  of  this  integral  to  a  simple  function  of  /j(r)  is  quite  involved  and 
appears  in  Section  A.l  of  this  thesis.  The  resulting  relationship  is  as  follows: 
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Rx(r)  =  4(1  +  M2(r)] 


(86) 


Incorporating  Equations  80,  83  and  86  into  Equation  84  allows  the  expression 
of  the  autocorrelation  of  the  quantization  error  as  a  function  of  h(t)  in  the  following 
manner: 


where,  as  before,  N  =  2£?  —  1. 
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3.4.2  The  Determination  of  Some  Noise  Related  Figures  of  Merit  for  a  Neg¬ 
ative-Exponential  Input 

S.f.S.  1  The  Normalized  Noise  Power  From  the  expression  provided 
above  as  Equation  87,  the  determination  of  an  expression  for  the  normalized  noise 
power  can  be  made.  This  normalized  noise  power,  or  the  mean-squared  error,  is  the 
autocorrelation  of  the  quantization  error  evaluated  at  a  time  differential  of  zero. 

The  determination  of  /z2(r)  at  a  time  differential  of  zero  is  accomplished  as 
follows: 
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Therefore,  the  normalized  noise  power  can  be  expressed  as 
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3.4.2.2  The  Signal-to- Quantization  Noise  Ratio  With  Nq  given  in  Equa¬ 
tion  89,  the  only  remaining  entity  required  to  produce  a  signal-to-quantization  noise 
ratio  is  the  normalized  signal  power.  This  quantity  is  determined  as  follows: 


5  =  Rx{t  =  0) 

=  E(x2) 

=  2x2  (90) 
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Creating  the  desired  ratio  then  yields 
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S.^.5  The  Determination  of  the  Quantization  Noise  Spectrum  for  a  Negative- 
Exponential  Input  Now  that  the  autocorrelation  of  the  quantization  error  is  available 
as  Equation  87,  the  Wiener-Khinchine  relationship  can  be  applied  in  a  similar  manner 
as  for  the  case  of  the  Gaussian  input.  Applying  this  relationship  and  recognizing  once 
again  that  the  Fourier  transform  operation  is  a  linear  operation  yields  the  following 
expression: 


which  takes  the  form 


<?£,(/)  =  £  +  bF[Rx(T)}  (93) 

fc= 0 

where  a*  is  as  defined  in  Equation  80,  and 
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If  an  identical  approach  is  taken  regarding  Equation  79,  the  following  relation¬ 
ship  results  for  the  output  spectrum: 
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As  with  the  case  of  the  Gaussian  input,  the  evaluation  of  the  •7r[/i2fc(T)]  ^erm  as 
k  increases  without  bound  is  perhaps  impossible  for  the  general  /z2(r).  A  manageable 
/i2(r)  which  satisfies  Equation  88  is 

H2{t)  =  exp(-a|r|)  (96) 

which  is  identical  to  the  input  autocorrelation  function  considered  for  the  Gaussian 
input.  The  corresponding  input  autocorrelation  function  is 

Rx{t)  =  .Tq[1  +  exp(— a|r|)]  (97) 


Applying  these  functions  to  the  error  power  spectral  density  equation  results  in 
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(98) 


Similarly, 
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It  should  be  noted  that  for  the  general  case, 


(99) 


00 

GEq{f)  =  ak^[n2k{r)\  +  bxlF[p2(r)]  +  (a0  +  bx20)8(f) 


k=l 


(100) 


Since  the  value  of  b  is  usually  negative  and  tends  to  approach  -1  as  the  number  of 
quantization  levels  increases,  care  must  be  taken  to  ensure  that  the  value  uq  +  bx\ 
provides  a  valid  power  spectral  density  quantity.  In  other  words,  the  condition 


Go  d"  bx q  ^  0 


(101) 
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must  be  met. 


Using  Equation  80, 

ao  =  q2  ^J/.-exp  — )  (102) 

Using  this  identity  and  inserting  Equation  94  into  the  required  condition  yields  the 
following  requirement: 

g(x  =  0)  >  2<72  ^2  n  exP  ~  xo  -?Eex  p(“)  (103) 

L  n=l  \  •'Co/  1=1  V  xO  j 

Since  the  choice  of  a  g(x  =  0)  value  directly  afFects  the  ao  term,  the  quantiza¬ 
tion  noise  can  be  minimized  if  the  g(x  =  0)  value  is  chosen  to  satisfy  Equation  103 
at  equality.  Consequently,  the  identity 

a0  =  -bxl  (104) 

can  be  assumed,  unless  Equation  103  at  equality  provides  either  a  complex  or  a 
negative  value  for  g(x  =  0).  If  this  becomes  the  case,  g(x  =  0)  can  be  chosen  as  a 
zero  value,  and  hence 

«0  =  <?2  £exp(-— )  (105) 

V  x0 ) 

3.5  The  Sinusoidal  Case  with  Random  Phase 

3.5.1  The  Noise  Autocorrelation  Problem  for  a  Sinusoidal  Input  luith  Random 
Phase  If  the  input  to  the  quantizer  consists  of  a  signal  which  possesses  the  charac¬ 
teristics  of  a  sine  wave  with  constant  amplitude  and  frequency  but  with  a  uniformly 
random  phase,  it  can  be  modeled  as  the  following  random  process: 

X(t)  =  A  cos(w0i  +  <I>)  (106) 
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where  the  probability  density  function  pertaining  to  the  random  phase  is 


W(cj>)  = 


i  -7T  <  ^  <  7T 
0  elsewhere 


(107) 


Through  the  utilization  of  the  corresponding  characteristic  function,  Barrett 
and  Lampard  (2:28)  showed  that  the  resulting  second  order  probability  density  func¬ 
tion  for  the  signal  level  of  the  quantizer  input  is 


n^;r)  =  4 


7 r 
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£  emTm  Tm  (^£j  cos (mw0r)  (108) 


for  |®i|  <  A  and  |x2|  <  >1,  where 


Cm  =  < 


1  m  =  0 

2  m  =  1, 2, 3, 


(109) 


and  Tm{x)  is  the  Tchebycheff  polynomial  of  the  first  kind,  defined  by 


Tm(x)  =  cos[ra  arccos(a;)] 


(110) 


The  resulting  first  order  probability  density  function  is 


- - — r  M  <  A. 

W(x)  =  {  AA*-**)* 

0  elsewhere 


(111) 


The  quantization  operation  to  be  acted  upon  this  input  is  identical  to  the 
operation  used  upon  the  Gaussian  input.  Ilowevei,  now  the  level  of  the  input  signal 
is  constrained  to  an  absolute  value  less  than  A ,  ’vhe’oas  the  Gaussian  and  negative- 
exponential  inputs  were  allowed  to  approach  unbounded  levels. 
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As  for  the  general  case,  the  autocorrelation  function  for  the  quantization  noise 
will  follow  the  relationship  described  in  Equation  10,  with  new  and  appropriate  limits 
placed  on  the  integral.  Equations  11  through  21  apply  in  a  similar  manner. 

The  orthogonality  property  for  the  Tchebycheff  polynomial  is 


i  Jl  cnTm(x)Tn(x)  (l  -  a2)4  dx  =  5, 

(2:28).  The  change  of  variables  mapping  x  to  ^  results  in 


(112) 


(1) 

1 

U; 

Tt  ( A 2  —  X2Y  _ 

dx  —  <5„ 


(113) 


which  implies  that  a  suitable  ^„(.t)  satisfying  Equation  12  is 


tfn(®)  = 


X 


or 


i>n(x)  =  x/e^cos 


a; 

n arccos  I  — 

A 


(114) 


(115) 


Inserting  the  expressions  given  as  Equations  111  and  115  into  Equation  21 
provides  the  following: 


M 


cn  —  9(x)y/^nFn(x)\_A  <ifV^n-^n(a:)|j;=t-9 


i=-M 


where 


d  „  .  . 

= 


1 


cos 


[7T  (A2  —  X2)* 
Some  modification  to  this  equation  reveals  that 


n  arccos 
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A)  J 
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v-  I'fau  ■  \ 

cn  =  .L  -fr -Kn\z) 
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nTT 
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X=tq 
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where 


dx 


Kn(x) 


n 


L  (A*-x*y>  J 


/  x\ 

COS 

n  arccos  -7 

L  \AJ 

Still  further  simplification  yields 


Crt  - 


L  ~  sm 


i=-M 


mt 


n  arccos 


(ijY 
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'g(x)y/e^ 


sm 


aVE. 


nir 

M 


x 

n  arccos  |  —  . . 
A)  J 


A 

-A 


UK 


t  u»(i) 

i=-M  V  A/ 

where  Un(x)  is  the  Tchebycheff  polynomial  of  the  second  kind,  defined  by 

Un(x)  =  sin[?r  arccos(x)] 

It  is  interesting  to  note  that 


(119) 


(120) 


(121) 


Un(—x)  =  sin[narccos(— x)] 

=  sin{n[7r  —  arccos(x)]} 

=  sm(mr)Tn(x)  —  cos(nir)Un(x ) 

=  (-!)”«  £!„(*) 


(122) 


Applying  this  property  to  Equation  120  provides 


Cn  — 


9\ArT 

717T 


T&-«Un(%)  n.odd 
0  n,  even 


(123) 
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It  is  now  possible  to  express  the  nonlinear  function,  <7(.t),  in  the  series  repre¬ 
sentation 


*>  -  <-> 

where,  as  in  the  Gaussian  case,  M  =  2®~l  —  1. 

By  utilizing  the  expressions  given  as  Equations  108  and  124,  and  by  rearranging 
the  orders  of  summation  and  integration,  Equation  6  becomes 


a„  2  M  M  oo  oo  co  ( 

Mr)  =  %  £  £  £££ 


cos(mo>0r) 


**  i=-M  t'o  t'o  m^O  l  £rn(2k  +  l)(2/  +  l) 

(j)  Ml  ( J ) 

1  1 


(125) 


Utilizing  the  orthogonality  property  given  by  Equation  113  allows  the  simpli¬ 
fication  of  Equation  125  to 


Ry(r)  = 


V  £  £  ^  f  cos[(2fc  +  l)tupr] 

71-2  <=-M  j=-M  to  1  (2k  +  !)2 


2f/2  ^  J  cos[(2&  +  l)w0r] 


*=0 


(2&  +  1)2 


i=-M 


(126) 


which  takes  the  form 


Ry(t)  =  J2  ak  cos[(2/c  -1-  l)w0r] 

k=0 


(127) 
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where 

2q2  1 

Uk  ~  7T2  (2k  +  l)2 

Now,  the  second  term  in  Equation  10  must  be  attacked  by  first  evaluating  the 
integral  given  by  Equation  8.  For  the  case  at  hand,  Equation  8  becomes 


rA 

=  LAx) 


[_7r  ( A 2  —  rc2) ?  J 


X 


dx 


(129) 


where  a1  is  the  normalized  power  of  the  input,  which  for  a  sinusoid  with  amplitude 
/I  is  Noting  that  the  integrand  is  an  even  function  of  x,  allows  the  use  of  the 
following  equation: 


fA  a(x) 

X 

Jo  g[X) 

n  ( A 2  —  x2Y 

dx 


(130) 


Ignoring  the  form  of  g(x)  derived  as  Equation  124  and  performing  the  integration 
given  as  Equation  130  as  a  finite  sum  of  integrals  over  intervals  where  <7(3;)  is  con¬ 
tinuous  yields 


c  = 
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/l2 


+ 

_lL 

It  A2 


E  /  + 
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r  (m  + l)  q  ( 
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(131) 


+  (W  +  i)  ([^-(M  +  ljVji)} 

Expanding  the  summation  a;  !  collecting  terms  provides  the  following  expression: 

(132) 


4  (l  \A  ,  (  a  2 
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The  autocorrelation  of  the  quantization  error  can  now  be  expressed  in  the 
following  form: 

CO 

REq{T)  =  X  °-kCOs[{2k  +  l)w0r]  +  (1  -  2 c)Rx{r)  (133) 

k=o 

which  introduces  another  new  problem.  The  relationship  between  Rx{t)  and 
cos(wor)  remains  to  be  determined.  To  determine  this  relationship,  the  following 
expression  must  be  considered: 


i-A  tA 

Rx(t)  =  /  /  XiX2W(xi,X2',r)dxidx2 

J—A  J-A 


-  X  \  -f  cos(?no.'0r ) 


m=0  I  * 


/: 


*i 


[J-A  (A2  _  x2y 


*1 


2M?  m  \  A 


~  Trr, 


dx  i 


(134) 


The  reduction  of  this  expression  to  a  simple  function  of  cos(mu>0T)  is  quite  involved 
and  therefore  appears  in  Section  A. 2  of  this  thesis.  The  simple  function  of  cos(mwo'r) 
is  as  follows: 


A 2 

Rx(t)  =  ~r  cos(w0r) 


(135) 


Incorporating  Equations  126,  132  and  135  into  Equation  10  allows  the  expres¬ 
sion  of  the  autocorrelation  of  the  quantization  error  as  a  function  of  cos (?mu0r)  in 
the  following  manner: 


-  ArE 


7 r 
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cos[(2A:  +  1)w0t] 
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E  Ww  (t) 

i=— A7 
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cos(w0r) 


(136) 


43 


where,  as  before,  M  =  2<?“1  —  1. 


3.5.2  The  Determination  of  Some  Noise  Related  Figures  of  Merit  for  a  Sinu¬ 
soidal  Input  with  Random  Phase 

3.5.2. 1  The  Normalized  Noise  Power  From  the  expression  provided 
above  as  Equation  136,  the  determination  of  an  expression  for  the  normalized  noise 
power  can  be  made.  As  mentioned  ior  the  previous  two  cases,  this  normalized  noise 
power,  or  mean-squared  error,  is  the  autocorrelation  of  the  quantization  error  eval¬ 
uated  at  a  time  differential  of  zero,  or 

Nq  =  Re„{t  =  0) 


3. 5. 2. 2  The  Signal-lo-Quantization  Noise  Ratio  Now  that  Equation  137 
has  been  provided,  a  signal-lo-quantization  ratio  derivation  becomes  trivial,  since  the 
normalized  signal  power  is 

S  =  Rx{  t  =  0)  =  Y  (138) 

Creating  the  desired  ratio  then  yields 


3.5.3  The  Determination  of  the  Quantization  Noise  Spectrum  for  a  Sinusoidal 
Input  with  Random  Phase  Now  that  the  autocorrelation  of  the  quantization  error 
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is  available  as  Equation  136,  the  Wiener-Khinchine  relationship  can  be  applied  in 
a  similar  manner  as  for  the  previous  two  cases.  Applying  this  relationship  and 
recognizing  that  the  Fourier  transform  operation  is  a  linear  operation  yields  the 
following  expression: 
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(140) 


which  takes  the  form 


I  oo 

Gsq{f)  =  r  ]E  a*{^[/  ~  (2A:  +  l)/o]  +  6[f  +  (2k  +  l)/o]} 

1  k=o 

+  g  fi(f  ~  fo)  +  5 {f  +  /o)] 

1  00 
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where  a*  is  as  defined  in  Equation  128  and 
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If  an  identical  approach  is  taken  regarding  Equation  128,  the  following  rela¬ 
tionship  results  for  the  output  spectrum: 

1  CO 

Gr(f)  =  ;E MHf  ~  (2t  +  l)/o]  +  Hf  +  (2fc  +  l)/„]}  (143) 

A  k= 0 

Note  that  in  order  for  Equation  141  to  represent  a  valid  power  spectral  density, 
the  condition 

do  +  b  >  0  (144) 

must  be  met. 

Since 


Ui(x)  =  sin(arccos  a:) 

= 


(145) 


Equation  128  can  be  used  to  reveal  that 


do  = 


8<y2 

7T2/12 


A  M  , 
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:=1 


(146) 


Making  the  appropriate  substitutions  into  the  condition  given  as  Equation  144  yields 
8  q2 


tt2A2 


A  M 

4+e  A*-V)' 


1=1 


4 q 

7T 


A  M  : 


t=l 


+  Y  >  0  (147) 


The  application  of  the  quadratic  equation  reveals  that  an  equivalent  condition  is 


T  +  (*-V)**  f 


(148) 


or 


j  -2 


(149) 
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In  order  for  the  preceding  expressions  regarding  the  sinusoidal  input  with  ran¬ 
dom  phase  to  be  valid,  care  must  be  taken  to  ensure  that  this  condition  on  the  ratio 
of  q  to  A  is  satisfied.  Also,  a  second  condition  exists  which  must  be  satisfied.  This 
condition,  namely 

i  <  1. 

A  ~  M 

can  be  noted  by  studying  many  of  the  previous  expressions. 
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IV.  Computer  Implementation  and  Computations 


4.1  The  Gaussian  Case 

4-1.1  Approaching  the  Gaussian  Input  Equations  When  approaching  the 
problem  of  attacking  the  equations  derived  for  the  Gaussian  input  problem,  the 
first  obstacle  to  overcome  is  the  determination  of  each  required  intermodulation 
coefficient,  a*,  by  using  Equation  41,  repeated  here  as 


(i<?)2\  jk*  fe  ) 

2<72  )  \J(2k  +  1)! 


(151) 


Studying  Equation  151  draws  particular  attention  to  the  ratio  of  H^k  to 
\J(2k  + 1)!.  Both  of  these  terms  increase  without  bound  as  k  increases  without 
bound.  Therefore,  somehow  this  ratio  must  be  approached  carefully. 

Szego  developed  an  approximation  for  a  related  Hermite  polynomial  (16:194) 
which  is  as  follows: 
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or,  for  n  being  even, 
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where 
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Relating  the  approximation  given  as  Equation  153  to  the  version  of  the  Hermite 
polynomial  used  in  this  thesis  reveals  that 
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for  n  being  even. 

Returning  to  the  ratio  under  consideration 
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In  order  to  simplify  this  ratio,  Stirling’s  approximation  can  be  utilized.  This 
approximation  is 

k\  «  e~kkk(2wk)i  (158) 

(5:29).  It  is  applicable  to  large  k,  and  is  accurate  to  within  0.5%  for  values  of  k 
larger  than  16.  Utilizing  this  approximation  reveals  that 
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Now,  for  values  of  k  larger  than  16,  the  following  approximation  for  ak  can  be 


used: 
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(160) 


For  values  of  /;  smaller  than  or  equal  to  16,  the  exact  expression  for  a^,  given  as 
Equation  151,  can  be  used.  Generating  the  Hermite  polynomials  necessary  to  use 
the  exact  equation  becomes  a  simple  matter  if  the  following  recurrence  relationship 
(13:2402)  is  recognized: 


Hn+i(x)  =  xIJn(x)  -  n//„_i (x) 


(161) 


where  H0(x )  =  1  and  H\(x)  =  x. 

Allowing  a'k  to  be  equivalent  to  (a2)2kJrlak,  with  ak  as  calculated  using  the 
exact  equation,  the  number  of  necessary  computations  for  determining  a'k  can  be 
reduced  by  noting  the  property  given  as  Equation  34.  This  property  allows  the 
modification  of  Equation  151  to 


2tt(2  k  +  1)! 
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#2/.-(0)  +  2  exp  - 


;=i 
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Now,  if  a'k  is  equivalent  to  (a 2)2k+iak,  with  a*  as  calculated  using  Equation  160, 
then  the  expression  used  to  calculate  the  normalized  noise  power  for  the  quantization 
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noise  can  now  be  derived  from  Equation  47  to  be 
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where  b  is  as  defined  in  Equation  53.  The  upper  limit,  R,  can  be  determined  by 
repeatedly  increasing  its  value  by  a  factor  of  10  until  further  increases  have  no 
substantial  effect  on  the  result.  For  the  purposes  of  providing  data  for  this  thesis, 
the  values  R  —  104,  R  =  10s ,  and  R  =  106  were  used.  Computer  memory  limitations 
placed  a  constraint  on  the  R  =  106  value,  although,  for  each  case,  this  was  sufficient 
for  providing  a  reasonable  approximation.  Particular  attention  was  paid  to  the  order 
of  the  summation.  The  intermodulation  coefficients  were  summed  in  the  order  of 
decreasing  values  of  k  in  an  attempt  to  sum  smaller  values  of  ak  first  and  reduce  the 
effects  of  computer  roundoff. 

Once  Nq  is  determined,  the  signal-to-quantization  noise  ratio  is  easily  obtained 
by  dividing  the  Nq  value  into  the  input  signal  power,  S  =  cr2. 

In  the  process  of  calculating  Nq,  it  became  necessary  to  determine  each  a'k,  each 
a'k ,  and  the  value  b.  These  same  values  can  be  used  to  provide  the  power  spectral 
densities  of  the  quantization  error  and  of  the  quantizer  output.  For  the  chosen  input 
autocorrelation  function,  Equations  55,  57,  and  56  reveal  the  following  one-sided 
power  spectral  densities: 
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Ge,U) 
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y-N  (2k  +  l)g/.- 
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+ 


(166) 


In  order  to  reduce  redundancy,  each  of  the  above  power  spectral  densities  are  one¬ 
sided  and  apply  only  to  /  >  0.  Note  that  these  power  spectral  densities  can  be 
plotted  in  increments  of  ^  versus  a  horizontal  axis  of  Therefore,  at  this  point, 
a  does  not  require  further  specification.  R  takes  on  the  same  value  as  that  used  to 
determine  the  final  a'k  for  earlier  consideration. 

Finally,  since  for  the  chosen  input  autocorrelation  function,  Rx(t  =  0)  =  a2  = 
1.  This  implies  that  a*  =  a'k  and  a/.-  =  a'k.  Therefore,  all  quantities  needed  to 
determine  the  power  spectral  densities  are  identical  to  those  used  to  determine  the 
normalized  noise  power. 


4.1.8  Programming  for  Gaussian  Input  Results  The  computer  program  sub¬ 
routines  which  compute  the  normalized  noise  power,  signal-to-quantization  noise 
ratio,  and  each  of  the  relevant  power  spectral  densities  pertaining  to  the  chosen  in¬ 
put  autocorrelation  function  have  been  coded  into  the  Fortran  77  computer  language 
and  can  be  found  in  Section  B.l  of  this  thesis.  This  code  applies  to  the  R  =  10,000 
case  only.  Only  minor  modifications  are  necessary  to  increase  R. 

A  synopsis  of  the  subroutines  which  have  been  used  to  produce  the  results 
given  later  in  this  thesis  appears  in  Table  2. 

4. 1.3  The  Gaussian  Input  Results  Once  the  required  subroutines  were  coded, 
they  were  used  to  generate  the  normalized  noise  powers  and  signal-to-quantization 
noise  ratios  for  the  quantization  process  ranging  from  1  to  8  bits.  In  order  to  obtain 
the  normalized  noise  powers,  a  unit  input  standard  deviation  was  assumed.  However, 
the  calculated  signal-to-quantization  noise  ratios  are  valid  regardless  of  the  input 
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Table  2.  Subroutines  Used  for  the  Gaussian  Input  Case 


Subroutine 

Purpose 

Called  By 

nopoga 

Calculates  the  normalized  noise  power 
and  the  signal-to-quantization  noise 
ratio. 

User.  This  sub-outine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
standard  deviation  of  the  Gaussian  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

pospga 

Determines  the  power  spectral  densities 
of  the  quantization  error,  the  quantizer 
output,  and  the  quantizer  input  for  the 
chosen  input  autocorrelation  function 
and  places  them  in  files  named  gauerr, 
gauout,  and  gauin,  respectively. 

User.  This  subroutine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
standard  deviation  of  the  Gaussian  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

dtakga 

Determines  all  values  of  a'k  and  a'k  for 
k  =  0  through  k  =  R.  For  the  case 
provided  in  Section  B.l,  R  =  10,000. 

nopoga  or  pospga. 

clakgl 

Calculates  the  value  of  a'k  for  k  =  0 
through  k  =  16. 

dtakga. 

geth2k 

Determines  the  configuration  of  H^x) 
and  if  given  and 

Hiksiz)  or  if  k  =  0. 

clakgl. 

evevpl 

Evaluates  a  polynomial  possessing 
nonzero  coefficients  for  only  the  even 
powers  of  the  polynomial  argument. 

clakgl. 

facto 

Provides  the  factorial  of  an  integer. 

clakgl. 

clakg2 

Calculates  the  value  of  ak  for  k  =  17 
through  k  =  R.  For  the  case  provided 
in  Section  B.l,  R=  10,000. 

dtakga. 
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Table  3.  Calculated  Noise  Related  Figures  of  Merit  for  a  Gaussian  Input 


Number 

of 

Bits 

R 

Normalized 
Noise  Power 
(units  squared) 

Signal-to- 
Quantization 
Noise  Ratio  (dB) 

1 

l  SI 

3.61  •  10-1 

4.42 

2 

1.17  ■  10-1 

9.32 

3 

0.590 

3.71  •  10-2 

14.3 

4 

S9 

0.339 

1.13  •  10~2 

19.5 

5 

106 

0.191 

3.46  •  10"3 

24.6 

6 

106 

0.106 

1.02  •  10"3 

29.9 

106 

0.0586 

2.95  •  10-“ 

35.3 

106 

0.0313 

8.14  •  10“5 

40.9 

standard  deviation.  The  optimal  quantization  step  size  was  determined  to  three 
significant  digits  by  repeated  program  execution  over  a  simple  iterative  process.  The 
data  obtained,  along  with  the  value  of  R  used  to  obtain  the  data,  appears  in  Table  3. 

The  necessary  subroutines  were  also  used  to  determine  the  input,  the  output, 
and  the  error  power  spectral  densities  for  the  quantization  process  ranging  from  the 
use  of  1  to  5  bits.  The  input  power  spectral  density  for  the  chosen  input  autocorre¬ 
lation  function  appears  in  Figure  3. 

Figure  4  illustrates  the  trend  of  the  output  power  spectral  density  as  the  num¬ 
ber  of  bits  employed  increases  from  1  to  5.  Likewise,  Figure  5  illustrates  the  trend 
of  the  error  power  spectral  density  as  the  number  of  bits  used  increases  in  a  like 
manner. 

4-2  The  Negative-Exponential  Case 

4-2.1  Approaching  the  Negative-Exponential  Input  Equations  As  was  the  case 
with  anticipating  a  Gaussian  input,  the  problem  of  attacking  the  negative- exponential 
input  problem  begins  with  approaching  the  intermodulation  coefficients.  The  equa- 
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Figure  5.  The  Power  Spectral  Density  of  the  Quantization  Noise  for  a  Gaussian 
Input 


tion  for  determining  these  coefficients  appears  as  Equation  80  and  is  repeated  here 


as 


ak  _  JyVexp  (-11) 
k  q  \hv,exp\  xo ) 


(167) 


Studying  this  expression  draws  particular  attention  to  the  subtraction  operation 
between  the  two  Laguerre  polynomials.  Both  of  these  terms  become  difficult  to  eval¬ 
uate  as  k  increases  without  bound.  Therefore,  this  expression  must  be  approached 
carefully. 


Szego  developed  an  approximation  for  the  Laguerre  polynomial  (16:192)  which 
is  as  follows: 


-  /  \  _.i  f  x\  .  . 

Ln[x)  «  7 r  2  exp  1  —  1  ( nx ) 


cos 


X  1  7T ' 

2(nx)<  -  - 


(168) 


This  approximation  becomes  increasingly  accurate  as  n  becomes  large,  but  the  accu¬ 
racy  occurs  somewhat  more  slowly  than  the  approximation  for  the  Ilermite  polyno¬ 
mial  given  as  Equation  152  (16:192).  However,  the  approximation,  which  possesses 
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an  error  term  on  the  order  of  is  sufficiently  accurate  for  values  of  n  such  that 

n  >  50.  Therefore,  for  values  of  It  larger  than  50,  the  following  approximation  can 
be  used: 


#*w4‘ =  ,’(S“p(“^)r*“p(^:)(^ 


•  cos 


t~ 1  '  ®0 

kiq\ 3  7T 


®o 


4 


(  iq 

yr  *  exp  — 

\2®„, 


'(k-l)iqy* 

xo  J 


•  cos 


(It  —  l)i</\  2  7T 


®o 


1  2  I  N 

72® o  / 


/  iq 


-  \Srcxp  v  2^J  (ifc)',cos 


£ 


7T 


[i(fc  -  1)]  *  COS 


(/■:  -  i)iq\  2  7T 


®o  /  4 

2 


®0 


4 


(109) 


For  values  of  /c  such  that  k  <  50,  the  exact  expression  of  (if-  ,  given  as  Equa¬ 
tion  107,  can  be  used.  Generating  the  Laguerre  polynomial  difference  terms  necessary 
to  use  the  exact  equation  can  be  accomplished  if  the  following  identity,  as  provided 
by  Szego  (10:97),  is  applied: 


Therefore,  for  k  >  I , 


£*(*) =  £ 

r=0 


» 


(-*)" 


7‘! 


(170) 
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(171) 


Now,  if  ak  and  a k  are  determined  using  the  appropriate  equations,  the  expres¬ 
sion  used  to  calculate  the  normalized  noise  power  can  be  derived  from  Equation  89 
as 


so 

E 

k= o 


Nq  *  E  ak  +  E 


n 

E 

k= 51 


+  2 
so 


4"2?2EnexP  (-—) 

n=l  V  *0/ 


E  +  E  ^^xo 

A=0  k= 51 


(172) 


where  6  is  as  defined  in  Equation  94.  The  upper  limit,  R ,  can  be  determined  by 
repeatedly  increasing  its  value  by  a  factor  of  10  until  further  increases  have  no 
substantial  effect  on  the  result.  For  the  purposes  of  providing  data  for  this  thesis, 
the  values  R  =  104,  R  =  105,  and  R  =  106  were  used.  Computer  memory  limitations 
placed  a  constraint  on  the  R  =  106  value,  although,  for  each  case,  this  was  sufficient 
for  providing  a  reasonable  approximation.  Particular  attention  was  paid  to  the  order 
of  the  summation.  The  intermodulation  coefficients  were  summed  in  the  order  of 
decreasing  values  of  k  in  an  attempt  to  sum  smaller  values  of  a^.  first  and  reduce  the 
effects  of  computer  roundoff. 

Recall  that  before  this  expression  for  Nq  can  be  valid,  the  value  g(x  =  0) 
must  be  chosen  to  satisfy  the  condition  given  as  Equation  103.  Therefore,  before 
Equation  172  can  be  applied,  g(x  —  0)  must  be  determined  by  applying  Equation  103 
or  by  letting  g(x  =  0)  =  0  as  appropriate.  For  further  details,  please  refer  to  the 
text  accompanying  Equation  103. 
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Once  Nq  is  determined,  the  signal-to-quantization  noise  ratio  is  easily  obtained 
by  dividing  the  value  Nq  into  the  input  signal  power,  S  =  2xl. 

In  the  process  of  calculating  iV9,  it  became  necessary  to  determine  an  appropri¬ 
ate  g(x  =  0),  each  a*,  each  a*..,  and  the  value  b.  These  values  can  be  used  to  provide 
the  power  spectral  densities  of  the  quantization  error  and  of  the  quantizer  output. 
For  the  chosen  input  autocorrelation  function,  Equations  97,  99,  and  98  reveal  the 
following  one-sided  power  spectral  densities: 


In  order  to  reduce  redundancy,  each  of  the  above  power  spectral  densities  are  one¬ 
sided  and  apply  only  to  /  >  0.  Also  note  that  as  for  the  case  of  a  Gaussian  input, 
these  power  spectral  densities  can  be  plotted  in  increments  of  £  versus  a  horizontal 
axis  of  £.  Therefore,  at  this  point,  a  does  not  require  further  specification.  R  takes 
on  the  same  value  as  that  used  to  determine  the  final  a*  for  earlier  consideration. 

f.2.2  Programming  for  Negative-Exponential  Input  Results  The  computer 
program  subroutines  which  compute  the  normalized  noise  power,  signal-to-quan¬ 
tization  noise  ratio,  and  each  of  the  relevant  power  spectral  densities  pertaining  to 
the  chosen  input  autocorrelation  function  have  been  coded  into  the  Fortran  77  com¬ 
puter  language  and  can  be  found  in  Section  B.2  of  this  thesis.  This  code  applies  to 
the  R  =  10,000  case  only.  Only  minor  modifications  are  necessary  to  increase  R. 
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A  synopsis  of  the  subroutines  which  have  been  used  to  produce  the  results 
given  later  in  this  thesis  appears  in  Table  4. 

4-2.3  The  Negative-Exponential  Input  Results  Once  the  required  subroutines 
were  coded,  they  were  used  to  generate  the  normalized  noise  powers  and  signal- 
to-quantization  noise  ratios  for  the  quantization  process  ranging  from  1  to  8  bits. 
In  order  to  obtain  the  normalized  noise  powers,  a  unit  input  mean  was  assumed. 
However,  the  calculated  signal-to-quantization  noise  ratios  are  valid  regardless  of  the 
input  mean.  The  optimal  quantization  step  size  was  determined  to  three  significant 
digits  by  repeated  program  execution  over  a  simple  iterative  process.  Furthermore, 
the  optimal  value  for  the  quantizer  output  corresponding  to  the  first  quantization 
level  was  determined  as  well.  The  data  obtained,  along  with  the  value  of  R  used  to 
obtain  the  data,  appears  in  Table  5. 

The  necessary  subroutines  were  also  used  to  determine  the  input,  the  output, 
and  the  error  power  spectral  densities  for  the  quantization  process  ranging  from  the 
use  of  1  to  5  bits.  The  input  power  spectral  density  for  the  chosen  input  autocorre¬ 
lation  function  appears  in  Figure  6. 

Figures  7  through  11  illustrate  the  trer-’  of  the  output  power  spectral  density 
as  the  number  of  bits  employed  increases  from  1  to  5.  Note  that  the  delta  function 
appearing  at  £  =  0  increases  and  approaches  the  value  or  as  the  number 
of  bits  used  for  quantization  increases.  Figure  12  illustrates  the  trend  of  the  error 
power  spectral  density  as  the  number  of  bits  used  increases  in  a  like  manner. 
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Table  4.  Subroutines  Used  for  the  Negative-Exponential  Input  Case 


Subroutine 

Purpose 

Called  By 

nopone 

Calculates  the  normalized  noise  power 
and  the  signal-to-quantization  noise 
ratio. 

User.  This  subroutine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
mean  of  the  negative-exponential  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

pospne 

Determines  the  power  spectral  densities 
of  the  quantization  error,  the  quantizer 
output,  and  the  quantizer  input  for  the 
chosen  input  autocorrelation  function 
and  places  them  in  files  named  nexerr, 
nexout,  and  nexin,  respectively. 

User.  This  subroutine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
mean  of  the  negative-exponential  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

dtakne 

Determines  all  values  of  ajt  and  a*  for 
k  =  0  through  k  =  R.  For  the  case 
provided  in  Section  B.2,  ii=  10,000. 

nopone  or  pospne. 

getgO 

Determines  the  appropriate  g(x  =  0) 
in  order  to  minimize  error  while  satis¬ 
fying  the  necessary  conditions  for  valid 
computations. 

dtakne. 

claknl 

Calculates  the  value  of  a*  for  k  =  0 
through  k  =  50. 

dtakne. 

elpdt 

Evaluates  the  Laguerre  polynomial  dif¬ 
ference  term  for  a  particular  argument. 
This  term  is  the  evaluation  of  Lk(x)  - 
Lk-i{x)  for  the  given  argument. 

claknl. 

comb 

Evaluates  the  combination  function  of 
“rr  choose  n” .  In  other  words,  it  deter¬ 
mines  the  number  of  ways  that  n  items 
can  be  selected  from  m  total  items. 

elpdt. 

dfacto 

Finds  the  factorial  of  its  first  argument 
and  returns  the  factorial  as  its  second 
argument.  The  second  is  in  double  pre¬ 
cision  format  in  order  to  allow  larger 
values. 

elpdt. 

clakn2 

Calculates  the  value  of  fit  for  k  =  51 
through  k  =  R.  For  the  case  provided 
in  Section  B.2,  R=  10,000. 

dtakne. 
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Table  5.  Calculated  Noise  Related  Figures  of  Merit  for  a  Negative-Exponential 
Input 


R 

First  Quantization 
Level  Output 
Value  (units) 

Step 

Size 

(units) 

Normalized 
Noise  Power 
(units  squared) 

Signal-to- 
Quantization 
Noise  Ratio  (dB) 

1 

10“ 

0.001 

E19K 

3.77  •  lO"1 

7.24 

2 

10'1 

0.244 

1.08 

1.37  •  10"1 

11.7 

3 

10s 

0.221 

0.660 

4.96  •  lO"2 

16.1 

4 

10s 

0.161 

0.400 

1.70  •  10-2 

20.7 

5 

106 

0.104 

0.235 

5.75  •  10"3 

25.4 

6 

106 

0.065 

0.139 

1.86  •  10"3 

30.3 

106 

0.038 

0.0784 

5.81  ■  10"'1 

35.4 

106 

0.023 

0.0465 

1.81  •  lO"'1 

40.4 

Figure  9.  The  Power  Spectral  Density  of  a  3-Bit  Quantizer  Output  for  a  Negative- 
Exponential  Input 


Figure  10.  The  Power  Spectral  Density  of  a.  4-Bit  Quantizer  Output  for  a  Negative- 
Exponential  Input 


64 


s 


0.2 


0.4 


0.6 


CX 


0 


The  Power  Spectral  Deirs\ty 
Exponential  Input 


L 


a 

of  a  5-Bit  Quantizer 


Output 


for  a  Negative- 


//.3  The  Sinusoidal  Case  xoith  Random  Phase 

4-3.1  Approaching  the  Random  Sinusoidal  Inpxit  Equations  For  the  case  of 
this  class  of  inputs,  computations  become  more  direct  and  straightforward  than  for 
the  prior  two  cases.  As  before,  the  problem  begins  with  approaching  the  inter¬ 
modulation  coefficients.  The  equation  for  determining  these  coefficients  appears  as 
Equation  128,  and  is  repeated  here  as 

_  2 q2  1 

^  ~  7T2  (2k  +  l)2 


Applying  the  property  given  as  Equation  122  to  Equation  176  reveals  that 


ak  = 


2  q1 


7 r2  (2k  +  l)2 


tWO)  +  2  ]T)  t/2A-+i  (^j 


(177) 


where 

U2k+i(x )  =  sin[(2fc  +  1)  arccos(x)]  (178) 

Now,  using  Equation  177,  the  expression  used  to  calculate  the  normalized  noise 
power  can  be  derived  from  Equation  137  as 


R 


A2  4  q 


k= 0  Z  2* 

R 

Y  a>=  + b 

k= 0 


A  " 


^ +2  (A* -mV) 


m= 1 


(179) 


where  b  is  as  defined  in  Equation  142.  The  upper  limit,  R,  can  be  determined 
by  repeatedly  increasing  its  value  by  a  factor  of  10  until  further  increases  have  no 
substantial  effect  on  the  result.  For  the  purpose  of  providing  data  for  this  thesis,  the 
values  R  =  10'1  and  R  —  105  were  used.  Particular  attention  was  paid  to  the  order 
of  the  summation.  The  intermodulation  coefficients  were  summed  in  the  order  of 
decreasing  values  of  k  in  an  attempt  to  sum  smaller  values  of  ak  first  and  reduce  the 
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effects  of  computer  roundoff. 

Recall  that  before  this  expression  for  Nq  can  be  valid,  the  ratio  of  q  to  A  must 
meet  certain  criteria  as  defined  by  the  conditions  given  as  Equation  149  and  150. 
Therefore,  before  Equation  179  can  be  applied,  the  ratio  of  q  to  A  must  be  tested 
for  applicability. 

Once  Nq  is  determined,  the  signal-to-quantization  noise  ratio  is  easily  obtained 
by  dividing  the  value  of  Nq  into  the  input  signal  power,  S  =  y-. 

In  the  process  of  calculating  Nq,  it  becomes  necessary  to  determine  each  a ^  and 
the  value  b.  These  same  values  can  be  used  to  provide  the  power  spectral  densities 
of  the  quantization  error  and  of  the  quantizer  output.  Equations  135,  143,  and  141 
reveal  the  following  one-sided  power  spectral  densities: 

Gx(f)  =  Y«(/-/o)  (180) 

CM/)  *  E*#-(21+l)/.]  (181) 

fc=0 

Gb,U)  »  E*#-( 2*  +  i)/o) 

k-\ 

+  (do  +  b)8(f  —  /o)  (182) 

In  order  to  reduce  redundancy,  each  of  the  above  power  spectral  densities  are  one¬ 
sided  and  apply  only  to  /  >  0.  Also  note  that  for  a  random  sinusoidal  input,  these 
power  spectral  densities  can  be  plotted  versus  a  horizontal  axis  in  increments  of  /0 . 
Therefore,  at  this  point,  f0  does  not  require  further  specification.  Finally,  the  value 
T  can  be  limited  in  order  to  produce  an  uncrowded  input.  The  limited  value  of  T 
will  produce  a  spectrum  for  0  <  /  <  (2 T  +  1  )/0.  The  value  of  T  must  be  chosen  to 
be  smaller  than  that  of  R. 

4-3.2  Programming  for  Random  Sinusoidal  Inpxit  Results  The  computer  pro¬ 
gram  subroutines  which  compute  the  normalized  noise  power,  signal-to-quantization 
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Table  6.  Subroutines  Used  for  the  Random  Sinusoidal  Input  Case 


Subroutine 

Purpose 

Called  By 

noposi 

Calculates  the  normalized  noise  power 
and  the  signal-to-quantization  noise 
ratio. 

User.  This  subroutine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
amplitude  of  the  random  sinusoidal  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

pospsi 

Determines  the  power  spectral  densities 
of  the  quantization  error,  the  quantizer 
output,  and  the  quantizer  input  for  the 
chosen  input  autocorrelation  function 
and  places  them  in  files  named  sinerr, 
sinout,  and  sinin,  respectively. 

User.  This  subroutine  must  be  pro¬ 
vided  the  quantization  step  size,  the 
amplitude  of  the  random  sinusoidal  in¬ 
put,  and  the  number  of  bits  used  for 
quantization. 

testra 

Tests  the  given  ratio  of  the  quantiza¬ 
tion  step  size  to  the  amplitude  of  the 
random  sinusoidal  input.  If  the  ratio 
given  does  not  allow  valid  results,  an 
appropriate  message  is  printed  and  sub¬ 
sequent  calculations  are  forgone. 

noposi  or  pospsi. 

dtaksi 

Determines  all  values  of  a*  for  k  =  0 
through  k  =  R.  For  the  case  provided 
in  Section  B.3,  R=  10,000. 

noposi  or  pospsi. 

claksi 

Calculates  the  value  of  a*  for  k  =  0 
through  k  =  R.  For  the  case  provided 
in  Section  B.3,  R=  10,000. 

dtaksi. 

evuk 

Evaluates  the  Tchebycheff  polynomial 
of  the  second  kind,  Uk(x). 

claksi. 

noise  ratio,  and  each  of  the  relevant  power  spectral  densities  have  been  coded  into 
the  Fortran  77  computer  language  and  can  be  found  in  Section  B.3  of  this  thesis. 
This  code  applies  to  the  R  =  10, 000  and  T  —  20  case  only.  Only  minor  modifications 
are  necessary  to  increase  R  or  change  T. 

A  synopsis  of  the  subroutines  which  have  been  used  to  produce  the  results 
given  later  in  this  thesis  appears  in  Table  6. 

4-3.3  The  Random  Sinusoidal  Results  Once  the  required  subroutines  were 
coded,  they  were  used  to  generate  the  normalized  noist  ’^'vcrs  and  signal-to-quanti- 
zation  noise  ratios  for  the  quantization  process  rang!  w  8  bits.  In  order  to 
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Table  7.  Calculated  Noise  Related  Figures  of  Merit  for  a  Random  Sinusoidal  Input 


Number 

of 

Bits 

R 

Normalized 
Noise  Power 
(units  squared) 

Signal- to- 
Quanlization 
Noise  Ratio  (dB) 

1 

10" 

1.58 

1.18  •  10-1 

6.26 

2 

10" 

0.607 

2.24  •  lO"2 

13.5 

3 

10" 

0.274 

5.12 -10-3 

19.9 

4 

10" 

0.131 

1.25  •  lO"3 

26.0 

5 

10" 

0.0639 

3.10  •  lO"" 

32.1 

6 

105 

0.0316 

7.81  •  lO"5 

38.1 

105 

0.0158 

2.12 -10"5 

43.7 

10s 

0.00784 

5.01  •  10"6 

50.0 

obtain  the  normalized  noise  powers,  a  unit  amplitude  was  assumed  for  the  random 
sinusoidal  input.  However,  the  calculated  signal-to-quantization  noise  ratios  are 
valid  regardless  of  the  input  amplitude.  The  optimal  quantization  step  size  was 
determined  to  three  significant  digits  by  repeated  program  execution  over  a  simple 
iterative  process.  The  data  obtained,  along  with  the  value  of  R  used  to  obtain  the 
data,  appears  in  Table  7. 

The  necessary  subroutines  were  also  used  to  determine  the  input,  the  output, 
and  the  error  power  spectral  densities  for  the  quantization  process  ranging  from  the 
use  of  1  to  5  bits.  The  input  power  spectral  density  for  a  unit  input  amplitude 
appears  in  Figure  13. 

Figures  14  through  18  illustrate  the  trend  of  the  resulting  output  power  spectral 
density  as  the  number  of  bits  employed  increases  from  1  to  5.  Figures  19  through 
23  illustrate  the  trend  of  the  error  power  spectral  density  as  the  number  of  bits  used 
increases  in  a  like  manner. 
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Figure  15.  The  Power  Spectral  Density  of  a  2-Bit  Quantizer  Output  for  a  Random 
Sinusoidal  Input 


Figure  17.  The  Power  Spectral  Density  of  a  4-Bit  Quantizer  Output  for  a  Random 
Sinusoidal  Input 


Figure  18.  The  Power  Spectral  Density  of  a  5-Bit  Quantizer  Output  for  a  Random 
Sinusoidal  Input 
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Figure  19.  The  Power  Spectral  Density  of  the  1-Bit  Quantization  Noise  for  a  Ran 
dom  Sinusoidal  Input 


10 
1 

0.1 
0.01 

GS'(f)  0.001 
0.0001 
le-05 
le  —  06 
le-07 

0  5  10  15  20£  25  30  35  40 

Jo 

Figure  20.  The  Power  Spectral  Density  of  the  2-Bit  Quantization  Noise  for  a  Ran 
dom  Sinusoidal  Input 


Figure  21.  The  Power  Spectral  Density  of  the  3-Bit  Quantization  Noise  for  a  Ran 
dom  Sinusoidal  Input 


V.  Conclusions  and  Recommendations 


5. 1  Conclusions 

For  three  classes  of  input  signals,  this  thesis  has  developed  a  relationship  be¬ 
tween  the  number  of  quantization  levels  and  the  resulting  noise  characteristics.  For 
each  case,  this  relationship  was  characterized  by  expressions  for  the  normalized  noise 
power,  the  signal-to-quantization  noise  ratio,  the  quantization  error  power  spectral 
density  and  the  quantizer  output  power  spectral  density.  These  expressions  were  in 
turn  used  to  obtain  the  results  given  in  Tables  3,  5  and  7.  Furthermore,  by  assuming 
the  input  power  spectral  densities  shown  in  Figures  3,  6  and  13,  the  quantization 
error  power  spectral  densities  were  determined  to  appear  as  shown  in  Figures  5, 
12  and  19  through  23  as  applicable  to  the  corresponding  input  signal  classification. 
Similarly,  the  quantizer  output  power  spectral  densities  were  determined  to  appear 
as  shown  in  Figures  4,  7  through  11  and  14  through  18. 

In  actuality,  this  thesis  effort  resulted  in  no  unexpected  results.  However,  there 
was  a  discovery  that  certain  requirements  regarding  quantization  parameters  were 
to  be  met  before  the  derived  theoretical  expressions  became  valid.  This  discovery 
was  not  anticipated.  These  requirements  are  summarized  in  Table  8. 

By  comparing  the  signal-to-quantization  noise  ratios  of  the  three  classes  of  in¬ 
puts,  it  is  evident  that  the  Gaussian  and  negative-exponential  input  cases  result  in 


Table  8.  Quantization  Parameter  Requirements  for  Valid  Expressions 


Input  Signal 

Parameter 

Condition 

Distribution 

Affected 

Required 

Gaussian 

None 

N/A 

N  egati  ve-  Exponen  ti  al 

g(x  =  0) 

See  Equation  103 

Random  Sinusoidal 

SL 

A 

See  Equations  149  and  150 
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similar  ratios,  particularly  as  the  number  of  bits  used  in  the  quantization  process 
increases.  In  contrast,  the  random  sinusoidal  input  case  fares  much  better.  The 
reason  for  this  better  performance  is  that  the  random  sinusoidal  case  has  no  possi¬ 
bility  of  providing  an  input  larger  than  A.  The  other  two  cases  must  account  for 
the  probability  of  inputs  approaching  infinity.  Therefore,  as  the  numbei  of  bits  used 
increases,  the  optimal  quantization  step  size  leads  to  a  higher  saturation  level.  This 
trend  is  not  necessary  for  the  case  of  the  random  sinusoidal  input.  Consequently, 
the  optimal  step  sizes  are  much  smaller  and  lead  to  a  more  accurate  representation 
of  the  input. 

5.2  Recommendations 

It  is  recommended  that  further  studies  be  directed  toward  incorporating  the 
effects  of  sampling  into  the  results  obtained  by  this  thesis.  Recall  that  this  thesis 
was  limited  in  scope  to  a  continuous-time  quantizer. 

It  is  also  recommended  that  further  work  be  done  to  extend  the  results  of  this 
thesis  effort  to  include  non-uniform  quantization.  It  is  well  known  that  non-uniform 
quantization,  although  more  difficult  to  theoretically  analyze,  provides  better  noise 
performance  than  uniform  quantization. 

Finally,  further  efforts  regarding  the  consideration  of  additional  classes  of  input 
signals  are  also  recommended.  The  three  input  signal  classifications  studied  by  this 
thesis  are  only  a  subset  of  the  signals  relevant  to  today’s  applications. 
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Appendix  A.  Key  Derivations 


A.l  The  Determination  of  a  Simple  Relationship  between  Rx{T)  and  /i(t)  for  a 
Negative-Exponential  Input 

The  integral  under  consideration  for  determining  the  subject  relationship  was 
expressed  as  Equation  85  and  is  restated  here  as 


2y/xlx2  p(t) 
x0  1  -  p2(t) 

•exp(-^F7k)  ^ 

By  rearranging  the  double  integral  and  by  letting 

-  1 
01  ~  *o[l  -  /*2(t)] 

and 


no 


X\X2 


x20[1-p2(t)} 


/o 


Xo  1  -  ju2(r) 
=  aV®i/i(r) 


(183) 


(184) 


(185) 


Equation  183  can  be  written  as 


a  f  r°°  ) 

Rx(r}=—  Jo  |,r2exp(-a»2 )  [xi  exp(-a$i)/o(2/0x/T7)  dx\)  dx2j  (186) 

Applying  an  integral  identity  given  by  Gradshteyn  and  Ryzhik  (7:720)  results  in 


(X  .  oo  1  /  fit  \ 

Rx(r)  =  —  /  x2exp(-a.r2)  — 5-exp  — 

.To  -'0  < 

'P 


L  poa  \^a/ 


M_30 

2»U 


a 


dxi 


(187) 
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where  M\}ll{z )  is  the  Whittaker  function  (7:1059)  defined  by 


MxM  =  exp  (-0  $  (p  -  A  +  2/i  +  1;  2)  (188) 

The  degenerate  hypergeometric  function  (7:1058),  $(£,7;  2),  is  defined  by 

$(£>7;*) 

7  A*  717  T  *'■ 

J-lU^  J.  9\  r3 

(189) 


,  +  i£  + 

7 1 !  7(7  +  1)21 

+  !)(£  + 2)  *3 
7(7  +  1)(7  +  2)  3! 


Applying  the  identities  given  as  Equations  188  and  189  to  Equation  187  and 
letting  z  —  ^  yields 


1  /■<*> 

Rx(r)  =  -  /  ®9exp(-Q®2) 

axo  Jo 


1 

=  -  /  a:2exp(-a:a;2) 

aro  Jo 

(n  +  1)*"' 

ho  n!  . 

-  -  /  x2  exp(-o\r2) 

axo  Jo 

( dz 

"  00  n+1 ' 

* 

TL ^ 

Ln=0  n •  J 

=  -  /  a;2exp(-a\T2)  { 

axo  Jo 

\± 

{ dz 

co  nl  ' 

+on!J 

3 z2  4z3 

1  +  2z  +  ~W  +  IT  + 


(1X2 
|  (1X2 
•  (1X2 


(1X2 


d_ 

dz 


(ze2) 


,dx  2 


1 

—  -  /  ®2exp(-a®2) 

axo  Jo 

1  [°° 

=  -  /  x2exp(-ax2)(l  +  z)ez  dx2 

axo  Jo 


Recalling  Equation  185  and  recalling  that  2  =  ^  reveals  that 
1  r00  ( 

Rx\r)  =  —  Jo  exp(-cvx2)[i  +  a/t2(r).r2] 

•  exp[a//2(r)x2]|  (lx2 


1  -  A/v 

=  —  I  [x2  +  a/.i2(r)xl]  exp{— a[l  -  /j,2(t)]x2}  dx2 
ctxo  Jo 

=  -  /  a:2exp{-a[]  -  h2(t))x2)  dx2 

axo  L/o 


(190) 
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(191) 


+  ~ — ~~  /  S^eXpf— tt[l  —  /f5(^))'C'4  'l't'2 
Xo  Jo 

M2(r)  r  2 


1 


+ 


a.T0  [a2[l  -  /t2(r)]2 J  ®0  L^i1  ~  /{2(t)]3 


Finally,  recalling  Equation  184  reveals  that 


■ftA-(r)  =  a&l  +  (i2(r)] 


(192) 


A. 2  The  Determination  of  a  Simple  Relationship  between  Rx(t)  and  cos(mw07) 
fc  '  a  Sinusoidal  Input  with  Random  Phase 

The  expression  under  consideration  for  determining  the  subject  relationship 
was  expressed  as  Equation  134  and  is  restated  here  as 


Kx(r)  =  -7  cos (mw0r )l] 


(193) 


m- 0 


where 


Xm  =  [A  - - - -Tm  (^)  dx 

J-A  (A*  -  ,r!)5  \AJ 

-L 


A  [A2  —  X2Y 


m  arccos  I  —  . . 

A)  J 


dx 


(194) 


Applying  the  trigonometric  substitution  x  =  Acosd  to  Equation  194  yields 


Jm  =  A  f  cos  0  cos(mO)  dO 
Jo 


= 


^  m  =  1 
0  elsewhere 


(195) 


Applying  this  result  to  Equation  193  provides  following  simple  expression: 


/i2 

Rx(t)  =  —cos(u}0t) 


(196) 
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Appendix  B.  Computer  Programming  Source  Code 


B.l  Source  Code  Used  for  the  Gaussian  Input  Results 


********** ************************ ************** *************** ********* 

*  SUBROUTINE  NOPOGA  * 

************************************************************************ 

*  This  subroutine  determines  the  normalized  noise  power  and  the  * 

*  signal-to-quantization  noise  ratio  (in  dBs)  when  given  the  * 

*  quantization  step  size,  the  standard  deviation  of  the  Gaussian  * 

*  input,  and  the  number  of  bits  used  in  the  quantization  process.  * 

************************************************************************ 


* 

Variables: 

* 

* 

q 

The  quantization  step  size 

* 

* 

sig 

The  standard  deviation  of  the  Gaussian  input 

* 

* 

noofbt 

The  number  of  bits  used  in  the  quantization 

* 

* 

process 

* 

* 

akpa 

The  array  which  ultimately  contains  all  of  the 

* 

* 

desired  a  sub  k  primes 

* 

* 

b 

An  additional  quantity  later  required  to  pro¬ 

* 

* 

vide  the  power  spectral  density  of  the 

* 

* 

quantization  noise 

* 

* 

nopo 

The  calculated  normalized  noise  power 

* 

* 

sinora 

The  signal-to-quantization  noise  ratio  in  its 

* 

* 

dimensionless  state 

* 

* 

sinodb 

The  signal-to-quantization  noise  ratio  in  dBs 

* 

* 

lev 

The  number  of  quantization  levels 

* 

★ 

k 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

************** **************************************************0******* 
subroutine  nopoga(q,sig,noofbt) 

real  q,  sig,  akpa(0: 10000) ,  b,  nopo,  sinora,  sinodb 

integer  noofbt,  lev,  k 

call  dtakga(q,sig,noofbt,akpa,b) 

lev  =  2** (noofbt) 

nopo  =  0. 

do  20  1c  «■  10000,  0,  -1 
nopo  =  nopo  +  akpa(k) 

20  continue 

nopo  =  nopo  +  (sig**2  *  b) 

write(6,30)  'The  normalized  noise  power  for  ',  lev, 

+  '  levels  with  a  step  size  of  q,  '  units' 

write (G , 40)  ’  and  a  Gaussian  input  with  a  standard  ', 

+  'deviation  of  ',  sig,  '  units  ' 

write(6,50)  '  is  ' ,  nopo,  '  units  squared.' 
sinora  =  (sig**2)/nopo 
sinodb  =  10.  *  loglO(sinora) 
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write(6,60)  'The  resulting  signal-to-quantization  noise  ’, 


+ 

’ratio 

is  ’,  sinodb,  '  dB.’ 

write(6,*) 

)  ) 

30 

format  (lx, 

a31,  i3,  a28,  fT.4,  a6) 

40 

format  (lx, 

a40,  al3,  f5.2,  a7) 

50 

format  (lx, 

a6,  gl0.3,  al5) 

60 

format  (lx, 

a43,  a9,  f5.2,  a4) 

end 


*  *  *  **  *  *  *  *  *  *  *  *  *  *  *  *  **  **  *  ****  *  ****  *  ****  *****  *  ****  **  **  **  *  **  **  ****  *  4c  *  *  *  *  **  *  *  * 

*  SUBROUTINE  POSPGA  * 

************************************************************************ 

*  This  subroutine  outputs  the  data  necessary  to  plot  the  power  * 

*  spectral  density  of  the  quantization  noise  for  a  Gaussian  input  * 

*  with  a  specified  autocorrelation.  This  data  allows  the  plotting  * 

*  of  the  power  spectral  density  in  increments  of  1/alpha  versus  * 

*  the  horizontal  axis  of  freq/alpha,  where  alpha  is  a  damping  * 

*  factor  pertaining  to  the  specified  autocorrelation  function.  * 

*************  lit**********  ************************************************ 


* 

Variables: 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

sig  : 

The  standard  deviation  of  the  Gaussian  input 

* 

* 

noofbt  : 

The  number  of  bits  used  in  the  quantization 

* 

* 

process 

* 

* 

pi  : 

The  standard  constant 

* 

* 

aka  : 

The  array  which  stores  the  previosly  calculated 

* 

* 

a  sub  k's 

* 

* 

b  : 

A  quan;’-y  calculated  earlier  which  is  necessary 

* 

* 

to  p*\  ride  the  power  spectral  density  of  the 

* 

* 

quantization  noise 

* 

* 

falph  : 

l’he  frequency  divided  by  the  parameter  alpha 

* 

* 

psdo  : 

The  output  power  spectral  density  in  increments 

* 

* 

of  1/alpha  for  a  particular  falph 

* 

* 

psde  : 

The  error  power  spectral  density  in  increments 

* 

* 

of  1/alpha  for  a  particular  falph 

* 

* 

psdi  : 

The  input  power  spectral  density  in  increments 

* 

* 

of  1/alpha  for  a  particular  falph 

* 

* 

indf  : 

An  index  used  to  iterate  through  falph 's 

* 

* 

>:  : 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

* 

dukpll  : 

The  value  2k  +  1 

* 

*****************************/ ****************************************** 


subrout ine  pospga( q , sig , noofbt) 

real  q,  sig,  pi,  aka(0: 10000) ,  b,  falph,  psdo,  psde,  psdi 
integer  noofbt,  indf ,  k,  dukpll 
pi  =  3.1416 
q  =  q/sig 
sig  =  1. 

call  dtak ga ( q, sig , noofbt, aka, b) 
open  (unit"10,fiie='gauerr') 
open  (unit=ll,file='gauout’) 
open  (unit=12,f ilc=’gauin5) 
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do  20  indf  =0,  236 
falph  =  indf/59. 
psdo  =  0. 

do  10  k  =  10000,  0,  -1 
dukpll  =  2  *  k  +  1 
psdo  =  psdo  +  (dukpll  *  aka(k))/ 

+  (dukpll**2  +  (2.  *  pi  *  falph)**2) 

10  continue 

psde  =  4.  *  (psdo  + 

+  (b/(l.  +  (2.  *  pi  *  falph)**2))) 

psdo  =  psdo  *  4. 

psdi  =  4. /(I.  +  (2.  *  pi  *  falph) **2) 
urite(10,30)  falph,  psde 
write(ll,30)  falph,  psdo 
write(12,30)  falph,  psdi 
20  continue 

30  format  (lx,  f8.6,  5x,  el2.5) 

close  (unit=10) 
close  (unit=ll) 
close  (unit=12) 

end 


****  *******************************************************  ********  ***** 
*  SUBROUTINE  DTAKGA  * 

************************************************************************ 


* 

This  subroutine  determines  all  values  of  a  sub  k  prime  for  k  = 

0  * 

* 

through  k  =  10, 

,000.  It  also  produces  the  constant  b,  which, 

* 

* 

along  with  the 

a  sub  k  primes,  is  necessary  to  determine  the 

* 

* 

quantization  noise  spectrum. 

* 

************************************************************************ 

* 

Variables : 

* 

♦ 

q  : 

The  quantization  step  size 

* 

♦ 

sig  : 

The  standa  »  deviation  of  the  Gaussian  input 

* 

* 

noofbt  : 

The  number  of  bits  used  in  the  quantization 

* 

process 

* 

♦ 

akpa  : 

The  array  which  ultimately  contains  all  of  the 

* 

* 

desired  a  sub  k  primes 

* 

b  : 

An  additional  quantity  later  required  to  pro¬ 

* 

♦ 

vide  the  power  specti  i]  density  of  the 

* 

♦ 

quantization  noise 

* 

♦ 

pi  : 

The  usual  constant 

* 

qsigra  : 

The  ratio  of  the  step  size  to  the  standard 

* 

♦ 

deviation  of  the  Gaussian  input 

* 

* 

sumex  : 

The  sum  of  the  iterated  exponential  terms 

* 

♦ 

exarg  : 

The  iterated  argument  of  the  exponential  term 

* 

♦ 

necessary  to  determine  b 

* 

h2kmnl  : 

The  polynomial  array  representation  of  the 

* 

* 

Hermitc  polynomial  cf  degree  2k  —  1 

* 

h2k  : 

The  polynomial  array  representation  of  the 

* 

* 

Hermite  polynomial  of  degree  2k 

* 

♦ 

m  : 

The  number  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non- 

* 

83 


*  zero  range  * 

*  ind  :  An  index  used  in  the  process  * 

*  k  :  The  parameter  which  indicates  the  desired  * 

*  a  sub  k  prime  * 

************************************************************************ 


subroutine  dtakga(q,sig,noofbt,akpa,b) 

real  q,  sig,  akpa(0: 10000) ,  b,  pi,  qsigra,  sumex,  exarg 
double  precision  h2kmnl(0:31) ,  h2k(0:32) 
integer  noofbt,  m,  ind,  k 
pi  =  3.1416 

m  =  2** (noofbt  -  1)  -  1 
qsigra  =  q/sig 
do  10  ind  =  0,  31 
h2kmnl(ind)  =  0. 
h2k(ind)  =  0. 

10  continue 


h2k(32)  =  0. 


do  20  k  =  0,  16 

call  clakgl(akpa(k) ,h2kmnl ,h2k, qsigra, q,m,k) 
20  continue 


do  30  k  =  17,  10000 

call  clakg2(akpa(k) .qsigra, q,m,k) 

30  continue 

sumex  =  0. 

exarg  =  (-(qsigra**2))/2. 
do  40  ind  =  1,  m 

sumex  =  sumex  +  exp((ind**2)  *  exarg) 

40  continue 

b  =  1.  -  sqrt(2./pi)  *  qsigra  *  (1+2.  *  sumex) 

end 

************************************************************************ 

*  SUBROUTINE  CLAKG1  * 

*  +  +  +  +  *  +  +  +  +  +  +  +  +  +  +  ^  +  +  +  +  +  +  +  +  +  ^  + 

*  This  subroutine  calculates  the  exact  value  of  a  sub  k  prime  and  * 

*  is  to  be  used  on  values  of  k  such  that  0  <=  k  <=  16.  Larger  * 

*  values  of  k  will  result  in  overflow  during  calculations.  Also,  * 

*  for  larger  values  of  k,  the  approximation  subroutine  CLAKP2  is  * 

*  quite  sufficient.  * 

************************************************************************ 

*  Variables :  * 


* 

akp  : 

The  desired  value  a  sub  k  prime 

* 

* 

h2kmnl  : 

The  polynomial  array  representation  of  the 

* 

* 

Herraite  polynomial  of  degree  2k  -  1 

* 

* 

h2k  : 

The  polynomial  array  representation  of  the 

* 

* 

Hermite  polynomial  of  degree  2k 

* 

* 

qsigra  : 

The  ratio  of  the  step  size  to  the  standard 

* 

* 

deviation  of  the  Gaussian  input 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

m  : 

The  number  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non¬ 

* 

* 

zero  range 

* 
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* 

k  : 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

* 

pi  : 

The  standard  constant 

* 

* 

msum  : 

The  total  evaluation  of  the  summation  term 

* 

* 

polarg  : 

The  iterated  argument  of  the  Hermite  polynomial 

* 

* 

in  the  summation  term  of  the  appropriate 

* 

* 

a  sub  k  prime  equation 

* 

* 

polqty  : 

The  iterated  evaluation  of  the  Hermite  poly¬ 

* 

nomial  in  the  summation  term  of  the  approp¬ 

* 

* 

riate  a  sub  k  prime  equation 

* 

* 

sumadd  : 

An  intermediate  value  used  to  obtain  msum 

* 

* 

squqty  : 

The  squared  quantity  which  includes  all  terms 

* 

* 

involving  Hermite  polynomial  evaluations 

* 

* 

facqty  : 

The  factorial  of  2k  +  1 

* 

* 

ord  : 

The  degree  of  the  Hermite  polynomials  to  be 

* 

* 

evaluated 

* 

* 

i  : 

An  index  used  in  the  process 

* 

* 

dukpll  : 

The  value  corresponding  to  2k  +  1 

* 

********************************* ************************* ************** 
subrout ine  clakg 1 ( akp , h2kmn 1 , h2k , qsigra , q , m , k) 

real  akp,  qsigra,  q,  pi,  msum,  polarg,  polqty,  sumadd,  squqty, 
+  facqty 

double  precision  h2kmnl(0:31) ,  h2k(0:32) 
integer  m,  k,  ord,  i,  dukpll 
pi  =  3.1416 
ord  =  2  *  k 

call  geth2k(h2kmnl,h2k,k) 
mcum  =  0. 
do  10  i  =  1,  m 

polarg  =  i  *  qsigra 
call  evevpl (h2k , ord , polarg , polqty ) 
sumadd  =  polqty  *  exp((-(polarg**2))/2. ) 
msum  =  msum  +  sumadd 
10  continue 

polarg  =  0. 

call  evevpl (h2k , ord , polarg, polqty ) 

squqty  =  (polqty  +  2.  *  msum)**2 

dukpll  =  ord  +  1 

call  facto(dukpll , facqty) 

akp  =  (squqty/facqty)  *  (q**2/(2.  *  pi)) 

end 

************************************************************************ 

*  SUBROUTINE  GETH2K  * 

************************************************************************ 

*  This  subroutine  determines  the  configuration  of  the  Hermite  * 

*  polynomials  of  degree  2k  and  of  degree  2k  -  1.  In  order  to  do  * 

*  so,  it  must  be  fed  the  Hermite  polynomials  of  degree  2k  -  2  * 

*  and  of  degree  2k  -  3  (the  previously  determined  Hermite  poly-  * 

*  nomials) .  * 

************************************************************************ 

*  Variables:  * 
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* 

h2kmnl  : 

The  polynomial  array  representation  of  the 

* 

* 

Hermite  polynomial  of  degree  2k  -  3  (when 

* 

* 

called)  and  then  of  degree  2k  -  1  (when 

* 

* 

returned) 

* 

* 

h2k  : 

The  polynomial  array  representation  of  the 

* 

* 

Hermite  polynomial  of  degree  2k  -  2  (when 

* 

* 

called)  and  then  of  degree  2k  (when 

* 

* 

returned) 

* 

* 

k  : 

The  parameter  which  indicates  the  desired  degree 

* 

* 

n  : 

The  degree  of  the  desired  h2kmni 

* 

* 

npll  : 

The  degree  of  the  desired  h2k 

* 

* 

coind  : 

An  index  used  in  the  process 

* 

subroutine  geth2k(h2kmnl,h2k,k) 

double  precision  h2kmnl(0:31) ,  h2k(0:32) 
integer  k,  n,  npll,  coind 
if  (k  .eq.  0)  then 
h2k(0)  =  1. 
return 

else 

n  =  2  *  k  -  1 

npll  =  2  *  k 

do  10  coind  =  1,  n,  2 

h2kmnl(coir.d)  =  h2k(coind  -  1)  -  (dble(n  -  1.) 

+  *  h2kmni( coind)) 

10  continue 

do  20  coind  =  2,  npll,  2 

h2k(coind)  =  h2kmnl (coind  -  1) 

+  -  (dble(n)  *  h2k(coind)) 

20  continue 

h2k(0)  =  (-n)  *  h2k(0) 
end  if 

end 

*** ***************** ***** *************************** ******* ************* 

*  SUBROUTINE  EVEVPL  * 

*  This  subroutine  evaluates  a  polynomial  possessing  nonzero  * 

*  coefficients  for  even  powers  of  the  polynomial  argument  only.  * 

*  The  maximum  degree  of  the  polynomial  which  can  be  handled  by  * 

*  this  subroutine  is  degree  32.  * 

************************************************************************ 


* 

Variables: 

* 

* 

polarr  : 

The  polynomial  array  representation  — 

* 

* 

polarr(n)  is  the  coefficient 

* 

* 

of  the  n-th  power  of  the  polynomial 

* 

* 

argument 

* 

* 

ora  : 

The  degree  of  the  polynomial  to  be  evaluated 

* 

* 

polarg  : 

The  argument  of  the  polynomial 

* 

* 

polans  : 

The  evaluation  of  the  polynomial  for  the 

* 

* 

argument 

* 

* 

poladp  : 

Iterations  of  polans  in  double  precision  form 

* 
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*  indexp  :  An  index  used  in  the  process  * 

************************************************************************ 

subroutine  evevpl (polarr , ord , polarg, polans) 
real  polarg,  polans 
double  precision  polarr(0:32)  ,  poladp 
integer  ord,  indexp 
poladp  =  polarr(O) 
do  10  indexp  =  2,  ord,  2 

poladp  =  poladp  +  polarr (indexp)  *  polarg**indexp 
10  continue 

polans  =  poladp 

end 

************************************** ********************************** 

*  SUBROUTINE  FACTO  * 

*************************************.  ********************************** 

*  This  subroutine  finds  the  factorial  of  its  first  argument  and  * 

*  returns  the  factorial  as  its  second  argument.  * 

**************************************  **********  *********************** 

*  Variables:  * 

*  facarg  :  The  int  r  whose  factor!  L  is  to  be  found  * 

*  facans  :  The  calculated  factorial  ox  facarg  * 

*  facind  :  An  index  used  in  the  process  * 

************************************************************************ 

subroutine  facto(facarg, facans) 
real  facans 

integer  facarg,  facind 
facans  =  1. 

if  (facarg  .le.  l)  return 
do  10  facind  =  2,  facarg 

facans  =  facans  *  facind 
10  continue 
end 

************************************************************************ 

*  SUBROUTINE  CLAKG2  * 

************************************************************************ 

*  This  subroutine  calculates  the  approximate  value  of  a  sub  k  * 

*  prime  and  is  to  be  used  on  values  of  k  such  that  * 

*  17  <=  k  <=  10,000.  Smaller  values  of  k  should  be  referred  to  * 

*  CLAKP1  for  an  exact  calculation.  Larger  values  of  k  will  be  * 

*  insignificant.  * 

************************************************************************ 

*  Variables :  * 


* 

* 

* 

* 

* 

* 

* 

* 

* 


akp  :  The  desired  value  a  sub  k  prime  * 

qsigra  :  The  ratio  of  the  step  size  to  the  standard  * 

deviation  of  the  Gaussian  input  * 

q  :  The  quantization  step  size  * 

m  :  The  number  transitions  between  quantization  * 

levels  in  the  positive  (or  negative)  non-  * 

zero  range  * 

k  :  The  parameter  which  indicates  the  desired  * 

a  sub  k  prime  * 
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*  pi  :  The  standard  constant  * 

*  cosarg  :  The  square  of  2k  +  1/2  -  used  to  increment  the  * 

*  argument  of  the  cosine  and  sine  terms  * 

*  msum  :  The  total  evaluation  of  the  summation  term  * 

*  mqty  :  An  intermediate  value  used  to  obtain  msum  * 

*  sinfac  :  The  factor  applied  to  the  incremented  sine  term  * 

*  squqty  :  The  squared  quantity  which  includes  the  * 

*  summation  of  the  cosine  and  sine  terms  * 

*  i  :  An  index  used  in  the  process  * 

*  dukpli  :  The  value  2k  +  1  * 

+  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  %  +  +  +  +  +  +  +  +  +  +  +  +  *  +  +  +  +  + 

subrout ine  clakg2 (akp , qs igra , q , m , k) 

real  akp,  qsigra,  q,  pi,  cosarg,  msum,  mqty,  sinfac,  squqty 
integer  m,  k,  i,  dukpli 
pi  =  3.1416 

cosarg  =  sqrt(2.  *  k  +  0.5) 
msum  =  0. 
do  10  i  =  1,  m 

mqty  =  cos (cosarg  *  i  *  qsigra) 

sinfac  =  ((i  *  qsigra)**3)/(24.  *  cosarg) 

mqty  =  mqty  +  sinfac  *  sin(cosarg  *  i  *  qsigra) 

msum  =  msum  +  mqty  *  exp((-((i  *  qsigra)**2))/4. ) 

10  continue 

squqty  =  (1.  +  2.  *  msum)**2 
dukpli  =  (2  *  k)  +  1 

akp  =  ((q**2)/ (2.  *  pi  *  dukpli  *  sqrt(pi  *  k)))  *  squqty 

end 


B.2  Source  Code  Used  for  the  Negative-Exponential  Input  Results 


*  *  $$  $$$  jf:  $£  sfc  *  *  *  *  $  *  sfofc  $  $  $  *  $  *  *  *  *  *  *  %  *  *  sjc  $  *  jf:  *  * + *  *  %  *  *  *  *  *  £  *  jjc  £  $  $  jfc  *  *  *  *  $  $  $  *  £  #  $  $  %  jje  jjc  * 

*  SUBROUTINE  N0P0NE  * 

************************************************************************ 

*  This  subroutine  determines  the  normalized  noise  power  and  the  * 

*  signal-to-quantization  noise  ratio  (in  dBs)  when  given  the  * 

*  quantization  step  size,  the  mean  of  the  negative-exponential  * 

*  input,  and  the  number  of  bits  used  in  the  quantization  process.  * 


************************************************************************ 

* 

Variables: 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

xO  : 

The  mean  of  the  negative-exponential  input 

* 

* 

nooibt  : 

The  number  of  bits  used  in  the  quantization 

* 

* 

process 

* 

* 

aka  : 

The  array  which  ultimately  contains  all  of  the 

* 

* 

desired  a  sub  k’s 

* 

* 

b  : 

An  additional  quantity  later  required  to  pro¬ 

* 

* 

vide  the  power  spectral  density  of  the 

* 
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* 

quantization  noise 

* 

] 

* 

go  : 

The 

desired  value  for  the  quantizer  output 

* 

i 

* 

corresponding  to  the  first  level  divided  by 

* 

l 

* 

the  step  size 

* 

* 

nopo  : 

The 

calculated  normalized  noise  power 

* 

j 

* 

sir.ora  : 

The 

signal-to-quantization  noise  ratio  in  its 

* 

* 

dimensionless  state 

* 

* 

sinodb  : 

The 

signal-to-quantization  noise  ratio  in  dBs 

* 

* 

lev  : 

The 

number  of  quantization  levels 

* 

* 

k  : 

The 

parameter  which  indicates  the  desired 

* 

* 

a  sub  k 

* 

************************************************************************ 


subroutine  nopone(q,xO,noofbt) 

j 

+ 

double  precision  q,  xO,  aka( 10000),  b,  gO,  nopo,  sinora, 
sinodb 

; 

; 

20 

integer  noofbt,  lev,  k 
call  dtakne(q,x0, noofbt, aka, b,g0) 
lev  =  2**(noofbt) 
nopo  =  0. 

do  20  k  =  10000,  0,  -1 
nopo  =  nopo  +  aka(k) 
continue 

1 

: 

i 

i 

+ 

nopo  =  nopo  +  (2.  *  (x0**2)  *  b) 

write(6,30)  ’The  normalized  noise  power  for  ’,  lev, 

’  levels  with  a  step  size  of  ',  q, 

, 

5 

i 

■? 

+ 

’  units’ 

+ 

write(6,40)  ’  and  a  negative-exponential  input  with  a  ', 

’mean  of  ’,  xO,  ’  units  is  ’ 

J 

+ 

write(6,50)  ’  ’,  nopo,  ’  units  squared.’ 

sinora  =  (2.  *  x0**2)/nopo 
sinodb  =  10.  *  loglO(sinora) 

write(6,60)  ’The  resulting  signal-to-quantization  noise  ’, 

’ratio  is  ’,  sinodb,  ’  dB.’ 

-■ 

i 

i 

j 

.r 

+ 

write(6,70)  ’The  quantizer  output  for  an  input  of  0  units’, 

’  is  ’ ,  gO  *  q,  ’  units. ’ 

i 

i 

30 

write(6,*)  '  ’ 

format  (lx,  a31,  i3,  a28,  f7.4,  a6) 

•> 

40 

format  (lx,  a43,  a8,  f5.2,  alO) 

; 

50 

format  (lx,  a3,  gl0.3,  al5) 

60 

format  (lx,  a43,  a9,  f5.2,  a4) 

| 

70 

format  (lx,  a44,  a4,  f5.3,  a7) 

end 

************************************************************************ 


*  SUBROUTINE  POSPNE  * 

********************************************************** ************** 

*  This  subroutine  outputs  the  data  necessary  to  plot  the  power  * 

*  spectral  density  of  the  quantization  noise  for  a  Negative-Expo-  * 

*  nential  input  with  a  specified  autocorrelation.  This  data  * 

*  allows  the  plotting  of  the  power  spectral  density  in  increments  * 

*  of  1/alpha  versus  the  horizontal  axis  of  freq/ alpha,  where  alpha  * 

*  is  a  damping  factor  pertaining  a  function  of  the  specified  * 


i 
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*  autocorrelation  function.  * 

*********** ******************** ***************************  ************** 


* 

Variables: 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

xO  : 

The  mean  of  the  negative-exponential  input 

* 

* 

noofbt  : 

The  number  of  bits  used  in  the  quantization 

* 

* 

process 

* 

* 

pi 

The  standard  constant 

* 

* 

aka  : 

The  array  which  stores  the  previosly  calculated 

* 

* 

a  sub  k’s 

* 

* 

b 

A  quantity  calculated  earlier  which  is  necessary 

* 

* 

to  provide  the  power  spectral  density  of  the 

* 

* 

quantization  noise 

* 

* 

gO  : 

The  desired  value  for  the  quantizer  output 

* 

* 

corresponding  to  the  first  level  divided  by 

* 

* 

the  step  size 

* 

* 

falph  : 

The  frequency  divided  by  the  parameter  alpha 

* 

* 

psdo  : 

The  output  power  spectral  density  in  increments 

* 

* 

of  1/alpha  for  a  particular  falph 

* 

* 

psde  : 

The  error  power  spectral  density  in  increments 

* 

* 

of  1/alpha  for  a  particular  falph 

* 

* 

psdi  : 

The  input  power  spectral  density  in  increments 

* 

* 

of  i/alpha  for  a  particular  falph 

* 

* 

psdde  : 

The  level  of  the  delta  function  which 

* 

* 

accompanies  the  error  power  spectral  density 

* 

* 

psddo  : 

The  level  of  the  delta  function  which 

* 

* 

accompanies  the  output  power  spectral 

* 

* 

density 

* 

* 

psddi  : 

The  level  of  the  delta  function  which 

* 

* 

accompanies  the  input  power  spectral 

* 

* 

density 

* 

* 

indf  : 

An  index  used  to  iterate  through  falph’ s 

* 

* 

k  : 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

************************************************************************ 
subroutine  pospne(q,xO, noofbt) 

double  precision  q,  xO,  pi,  aka(0: 10000) ,  b,  gO,  falph,  psdo, 

+  psde,  psdi,  psdde,  psddo,  psddi 

integer  noofbt,  indf ,  k 
pi  =  3.1416 

call  dtakne (q , xO , noofbt , aka , b , gO) 
open  (unit=13,file='nexerr’) 
open  (unit=14,file=’nexout’) 
open  (unit=15,f ile=’nexin’) 
do  20  indf  =  0,  236 
falph  =  indf/59. 
psdo  =  0. 

do  10  k  =  10000,  1,  -1 

psdo  =  psdo  +  (k  *  aka(k))/ 

+  (k**2  +  (2.  *  pi  *  falph) **2} 

10  continue 
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+ 


20 

30 

40 


psde  =  4.  *  (  psdo  + 

(b  *  x0**2)/(l.  +  (2.  *  pi  *  falph)**2)) 
psdo  =  psdo  *  4. 

psdi  =  4.  *  (x0**2)/(l.  +  (2.  *  pi  *  falph)**2) 
if  (indf  .eq.  0)  then 

psdde  =  aka(0)  +  (b  *  x0**2) 
psddo  =  aka(0) 
psddi  =  x0**2 

write(13,30)  falph,  psde,  psdde 
write(14,30)  falph,  psdo,  psddo 
write(15,30)  falph,  psdi,  psddi 
else  if  (indf  .eq.  1)  then 
psdde  =  0. 
psddo  =  0. 
psddi  =  0. 

write(l3,30)  falph,  psde,  psdde 
write(14,30)  falph,  psdo,  psddo 
write(15,30)  falph,  psdi,  psddi 

else 


write (13, 40)  falph,  psde 
write(14,40)  falph,  psdo 
write(15,40)  falph,  psdi 
end  if 
continue 

format  (lx,  f8.6,  5x,  el2.5,  5x,  el2.5) 

format  (lx,  f8.6,  Sx,  el2.S) 

close  (unit=13) 

close  (unit=14) 

close  (unit=15) 


end 

************************* *********************************************** 

*  SUBROUTINE  DTAKNE  * 

*  *  *  *  *  *  *  %  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  5*C  *  *  *  $  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  $  *  *  *  *  *  *  *  *  Jjc  *  *  *  *  *  %  *  *  *  * 


* 

This  subroutine 

determines  all  values  of  a  sub  k  for  k  =  0 

* 

* 

through  k  =  10, 

000. 

* 

************************************************************************ 

* 

Variables: 

* 

* 

aka  : 

The  array  which  ultimately  contains  all  of  the 

* 

* 

desired  a  sub  k's 

* 

* 

qxOra  : 

The  ratio  of  the  step  size  to  the  mean  of  the 

* 

* 

negative-exponential  input 

* 

* 

xO  : 

The  mean  of  the  negative-exponential  input 

* 

* 

n  : 

The  number  of  transitions  between  quantization 

* 

* 

levels 

* 

* 

k  : 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k 

* 

* 

ind  : 

An  index  used  in  the  process 

* 

* 

gO  : 

The  desired  value  for  the  quantizer  output 

* 

* 

corresponding  to  the  first  level  divided  by 

* 

* 

the  step  size 

* 

* 

q  : 

The  quantization  step  size 

* 
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*  b  :  An  additional  quantity  later  required  to  pro-  * 

*  vide  the  power  spectral  density  of  the  * 

*  quantization  noise  * 

********************************** ************* ************************* 

subroutine  dtakne (q , xO , noof bt , aka , b , gO) 

double  precision  q,  xO,  aka(0:10000) ,  b,  gO,  qxOra 

integer  noofbt,  n,  k 

qxOra  =  q/xO 

n  =  2**(noofbt)  -  1 

call  getgO (gO,q,xO, qxOra, n,b) 

do  20  k  =  0,  50 

call  claknl(aka(k) , qxOra, q,n,k,gO) 

20  continue 

do  30  k  =  51,  10000 

call  clakn2(aka(k) , qxOra, q,n,k,xO,gO) 

30  continue 

end 

*****  ******************************************************************* 

*  SUBROUTINE  GETGO  * 

************************************************************************ 


************************************************************************ 
subroutine  getgO (gO , q , xO , qxOra , n , b) 

double  pre>  ision  gO,  q,  xO,  qxOra,  b,  suraex,  exarg,  srbxO 
integer  n,  exind 
gO  =  0. 
sumex  =  0. 


* 

This  subroutine 

determines  what  the  quantizer  output  corre- 

* 

fl 

j 

i 

* 

sponding  to  the 

first  level  should  be  in  order  to  negate  or 

* 

* 

minimize  the  dc 

or  average  value  of  the  quantization  error.  In 

* 

t 

1 

i 

* 

other  words,  it 

determines  the  appropriate  g(x  =  0). 

* 

* 

It  also  produces  the  constant  b,  which,  along  with  the  a  sub  k’s 

.* 

* 

is  necessary  to 

determine  the  quantization  noise  spectrum. 

* 

************************************************************************ 

* 

Variables : 

* 

i 

* 

gO  : 

The  desired  value  for  the  quantizer  output 

* 

I 

4. 

* 

corresponding  to  the  first  level  divided  by 

* 

* 

* 

the  step  size  q 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

xO  : 

The  mean  of  the  negative-exponential  input 

* 

i 

* 

qxOra  : 

The  ratio  of  the  step  size  to  the  mean  of  the 

* 

1 

* 

negative-exponential  input 

* 

j 

* 

n  : 

The  number  transitions  between  quantization 

* 

j 

* 

levels 

* 

j 

¥ 

b  : 

An  additional  quantity  later  required  to  pro¬ 

* 

i 

* 

vide  the  power  spectral  density  of  the 

* 

} 

* 

quantization  noise 

* 

* 

sumex  : 

The  sum  of  the  iterated  exponential  terms 

* 

a 

* 

exarg  : 

The  iterated  argument  of  the  exponential  term 

* 

j 

* 

necessary  to  determine  b 

* 

* 

srbxO  : 

An  intermediate  value  used  to  determine  gO 

* 

* 

exind  : 

An  index  used  in  the  process 

* 

j 
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exarg  =  -qxOra 
do  10  exind  =  1,  n 

sumex  =  sumex  +  exind  *  exp (exind  *  exarg) 

10  continue 

b  =  1.  -2.  *  (qxCra**2)  *  sumex 
if  (b  .It.  0.)  then 
sumex  =  0. 
do  20  exind  =  1,  n 

sumex  =  sumex  +  exp(exind  *  exarg) 

20  continue 

srbxO  =  (xO  *  sqrt(-b))/q 
if  (sumex  .It.  srbxO)  gO  =  srbxO  -  sumex 
end  if 
end 

************************************************************************ 

*  SUBROUTINE  CLAKN1  * 

**************************************** ******************** ************ 

*  This  subroutine  calculates  the  exact  value  of  a  sub  k  and  * 

*  is  to  be  used  on  values  of  k  such  that  0  <=  k  <=  50.  Larger  * 

*  values  of  k  will  result  in  overflow  during  calculations.  Also,  * 

*  for  larger  values  of  k,  the  approxi- ation  subroutine  CLAKN2  is  * 

*  quite  sufficient.  * 

************************************************************************ 


* 

Variables : 

* 

* 

ak  : 

The  desired  value  a  sub  k 

* 

* 

qxOra  : 

The  ratio  of  the  step  size  to  the  mean  of  the 

* 

* 

negative-exponential  input 

* 

* 

q  : 

The  quantization  step  size 

* 

* 

n  : 

The  number  of  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non¬ 

* 

* 

zero  range 

* 

* 

k  : 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k 

* 

* 

gO  : 

The  desired  value  for  the  quantizer  output 

* 

* 

corresponding  to  the  first  level  divided  by 

* 

* 

the  step  size 

* 

* 

nsum  : 

The  total  evaluation  of  the  summation  term 

* 

* 

polarg  : 

The  iterated  argument  of  the  Laguerre  poly¬ 

* 

* 

nomials  in  the  summation  term  of  the 

*. 

* 

appropriate  a  sub  k  prime  equation 

■¥ 

* 

polqt  : 

The  iterated  evaluation  of  the  difference  of  the 

* 

* 

two  relevant  Laguerre  polynomials 

* 

* 

sumadd  : 

An  intermediate  value  used  to  obtain  nsum 

* 

* 

ind  : 

An  index  used  in  the  process 

* 

************************************************************************ 
subroutine  claknl ( ak , qxOra , q , n , k , gO) 

double  precision  ak,  qxOra,  q,  gO,  nsuin,  polaig,  polqt,  sumaad 

integer  n,  k,  ind 

nsum  =  0. 

do  10  ind  =  0,  n 

polarg  =  ind  *  qxOra 
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10 


call  elpdt(k, polarg, polqt) 
sumadd  =  exp(-polarg)  *  polqt 
if  (ind  .eq.  0)  sumadd  =  gO  *  sumadd 
nsum  -  nsum  +  sumadd 
continue 

ak  =  (q  t  nsum)**2 


ei-.d 

*  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  **  *  **  *  *  *  *  *  *  * *  *  ***  *  *  *  *  *  *  *  **  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  4c  **  *  * 

*  SUBROUTINE  ELPDT  * 

*****%**********%******  +  +  5f:****^**^  +  5M'*****  +  ******  + ***  +  ***♦*********** 

* 

* 

* 

* 

* 


This  subroutine  evaluates  the  Laguerre  polynomial  difference  * 
term  for  a  particular  argument.  This  term  is  the  evaluation  * 
of  the  Laguerre  polynomial  of  degree  k  minus  the  evaluation  * 

of  the  Laguerre  polynomial  of  degree  k  -  1  for  the  given  argu-  * 

ment .  * 

sic******************************************************?  /*************** 
* 

* 

* 

* 

* 

* 
t 
* 

* 

* 

* 

* 


Variables :  * 

k  :  The  parameter  which  indicates  the  desired  degree  * 

polarg  ;  The  iterated  argument  of  the  Laguerre  poly-  * 

nomials  in  the  summation  term  of  the  * 

appropriate  a  sub  k  prime  equation  * 

The  iterated  evaluation  of  the  difference  of  the  * 
two  relevant  Laguerre  polynomials  * 

An  index  through  the  appropriate  summation  term  * 
The  value  of  k  minus  1  * 

The  value  of  r  minus  1  * 

The  evaluation  of  the  combination  term  * 

The  evaluation  of  r  factorial  * 

***************  ********************************************************* 
subroutine  elpdt(k, polarg, polqt) 
integer  k,  r,  kmnl,  rmnl 

double  precision  polarg,  polqt,  cterm,  rfact 
if  (k  .eq.  0)  then 
polqt  =  1. 


polqt 

r 

kmnl 

rmnl 

cterm 

rfact 


else 


return 

e 

kmnl  =  k  -  1 
polqt  =  0. 
do  10  r  =  1, 
rmnl  =  r 


k 

-  1 


10 


call  comb(kmnl, rmnl, cterm) 
call  dfacto(r, rfact) 

polqt  =  polqt  +  ((cterm/rfact)  *  ( (-polarg) **r)) 
continue 
end  if 


end 

****** t************************************************************* 

*  SUBROUTINE  COMB  * 

************************************************************************ 

*  This  subroutine  evaluates  the  combination  function  of  * 

*  "m  choose  n’\  In  other  uords,  it  determines  the  number  of  ways  * 
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*  that  n  items  can  be  selected  from  m  total  items.  * 

***********************  *  ******  ********  lit***********************  ********** 

*  Variables:  * 


* 

m 

The  number  of  items  selected  from 

* 

* 

n 

The  number  of  items  selected 

* 

* 

cterm 

The  result  of  the  operation 

* 

* 

mmnn 

The  value  of  m  minus  n 

* 

* 

lo 

The  smallest  value  between  n  and  mmnn 

* 

* 

hi 

The  largest  value  betwef  n  +  1  and  mmnn  +  1 

* 

* 

ind 

An  index  used  in  the  process 

* 

+  5f:3t:  +  +  5f::J:  +  5*:3t:  +  *  +  *5tc  +  +  3|t5t:)Jof:5f:  +  +  )*c3t:  +  +  5*t3(c3|c^:  +  +  +  5|c  + ****  +  + +  +  *>►*  ************  ************ 

subroutine  comb (m,n, cterm) 

integer  m,  n,  mmnn,  lo,  hi,  ind 

double  precision  cterm 

mmnn  =  m 

-  n 

if  (mmnn 

.gt.  n)  then 

lo  = 

n 

hi  = 

mmnn  +  1 

else 

lo  = 

mmnn 

hi  = 

n  +  1 

end  if 

cterm  =  1 . 

10 


do  10  ind  =  m,  hi,  -1 
if  (lo  .gt.  1)  then 

cterm  =  cterm  *  (dble(ind)/lo) 
lo  =  lo  -  1 

else 

cterm  =  cterm  *  ind 
end  if 
continue 


end 

*  *  *  *  *  *  *  *  *  *  *  *  *  *  jf:  *  *  *  $  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  a|c  *  %  *  *  jfc  +  *  *  *  *  *  *  *  %  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  *  * 

*  SUBROUTINE  DFACTO  * 

*******************************************************!;.**************** 

* 

* 

* 


This  subroutine  finds  the  factorial  of  its  first  argument  and  * 
returns  the  factorial  as  its  second  argument.  The  second  * 

is  in  double  precision  format  in  order  to  allow  larger  values.  * 
************************************************************************ 


Variables: 

k 

kfact 

kind 


The  integer  whose  factorial  is  to  be  found 
The  calculated  factorial  of  facarg 
An  index  used  in  the  process 
***************<:**********♦**********+♦********************************* 

subroutine  dfacto(k, kfact) 
integer  k,  kind 
double  precision  kfact 
kfact  =  1. 

if  (k  .le.  1)  return 
do  10  kind  =  2,  k 

kfact  =  kfact  *  kind 
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10 


continue 


end 

************************************************* *********************** 

*  SUBROUTINE  CLAKN2  * 

************************************************************************ 

*  This  subroutine  calculates  the  approximate  value  of  a  sub  k  * 

*  and  is  to  be  used  on  values  of  k  such  that  * 

*  51  <=  k  <=  10,000.  Smaller  values  of  k  should  be  referred  to  * 

*  CLAKN1  for  an  exact  calculation.  Larger  values  of  k  will  be  * 

*  insignificant.  * 

************************************************************************ 


* 

Variables: 

* 

* 

ak 

The  desired  value  a  sub  k 

* 

* 

qxOra 

The  ratio  of  the  step  size  to  the  mean  of  the 

* 

* 

negative-exponential  input 

* 

* 

q 

The  quantization  step  size 

* 

* 

xO 

The  mean  of  the  negative-exponential  input 

* 

* 

g° 

The  desired  value  for  the  quantizer  output 

* 

* 

corresponding  to  the  first  level  divided  by 

* 

* 

the  step  size 

* 

* 

Pi 

The  standard  constant 

* 

* 

piov4 

The  standard  constant,  pi,  divided  by  4 

* 

* 

cosarl 

The  the  term  used  to  increment  the  argument 

* 

* 

of  the  first  cosine  term 

* 

* 

cosar2 

The  the  term  used  to  increment  the  argument 

* 

* 

of  the  second  cosine  term 

* 

* 

nsum 

The  total  evaluation  of  the  summation  term 

* 

* 

nqty 

An  intermediate  value  used  to  obtain  msum 

* 

* 

n 

The  number  transitions  between  quantization 

* 

* 

levels 

* 

* 

k 

The  parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

* 

ind 

An  index  used  in  the  process 

* 

************************************************************************ 
subrout ine  clakn2 ( ak , qxOr a , q , n , k , xO , gO ) 

double  precision  ak,  qxOra,  q,  xO,  g0,  pi,  piov4,  cosarl, 

+  cosar2,  nsum,  nqty 

integer  n,  k,  ind 
pi  =  3.1416 
piov4  =  pi/4. 

cosarl  =  2.  *  sqrt(k  *  qxOra) 
cosar2  =  2.  *  sqrt((k  -  1.)  *  qxOra) 
nsum  =  0. 
do  10  ind  =  1,  n 

nqty  =  (x0/((ind  *  k)**(0.25))) 

+  *  cos((sqrt(ind  *  1.)  *  cosarl)  -  piov4) 

nqty  =  nqty  -  ((l./((ind  *  (k  -  1))**(0.25))) 

+  *  cos((sqrt(ind  *  1.)  *  cosar2)  -  piov4)) 

nsum  =  nsum  +  (nqty  *  exp(-((ind  *  qx0ra)/2.))) 

10  continue 

ak  =  (q**(l .5))  *  sqrt(xO)  *  (l./pi)  *  nsum**2 
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end 


B.3  Source  Code  Used  for  the  Random  Sinusoidal  Input  Resxdts 


*********************************************** ************************* 

*  SUBROUTINE  NOPOSI  * 

************************************************************************ 

This  subroutine  determines  the  normalized  noise  power  and  the  * 
signal-to-quantization  noise  ratio  (in  dBs)  when  given  the  * 

a  sub  k’s  as  determined  by  DTAKSI,  the  quantization  step  size,  * 

the  amplitude  of  the  sinusoidal  input,  and  the  number  of  bits  * 

used  in  the  quantization  process.  * 

************************************************************************ 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 


Variables:  * 

q  :  The  quantization  step  size  * 

a  :  The  ampltitude  of  the  sinusoidal  input  * 

noofbt  :  The  number  of  bits  used  in  the  quantization  * 

process  * 

aka  :  The  array  which  ultimately  contains  all  of  the  * 
desired  a  sub  k’s  * 

b  :  An  additional  quantity  later  required  to  pro-  * 

vide  the  power  spectral  density  of  the  * 

quantization  noise  * 

nopo  :  The  calculated  normalized  noise  power  * 

sinora  :  The  signal-to-quantization  noise  ratio  in  its  * 

dimensionless  state  * 

sinodb  :  The  signal-to-quantization  noise  ratio  in  dBs  * 

k  :  The  parameter  which  indicates  the  desired  * 

a  sub  k  prime  * 

lev  :  The  number  of  quantization  levels  * 

valid  :  A  logical  indication  of  whether  the  qara  is  a  * 

valid  ratio  * 

************************************************************************ 
subroutine  noposi(q, a, noofbt) 

real  q,  a,  aka(0: 10000) ,  b,  nopo,  sinora,  sinodb 
integer  noofbt,  k,  lev 
logical  valid 

call  testra(q, a, noofbt, valid) 
if  (valid)  then 

call  dtaksi(q, a, noofbt, aka, b) 
lev  =  2** (noofbt) 
nopo  =  0, 


do  20  k  =  10000,  0,  -1 
nopo  =  nopo  +  aka(k) 

20  continue 

nopo  =  nopo  +  b 

write(6,30)  ’The  normalized  noise  power  for  ’,  lev, 
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+  ’  levels  with  a  step  size  of  ’,  q,  ’  units  ’ 

write(6,40)  ’  and  a  random  sinusoidal  input  with  an  ’, 

+  ’amplitude  of  a,  ’  units  ’ 

write(6,50)  ’  is  ’ ,  nopo,  ’  units  squared.’ 
sinora  =  ((a**2)/2)/nopo 
sinodb  =  10.  *  loglO(sinora) 

write(6,60)  ’The  resulting  signal-to-quantization  noise  ’, 
+  'ratio  is  ’,  sinodb,  ’  dB.’ 

write(6,*)  ’  ’ 
end  if 

30  format  (lx,  a31,  i3,  a28,  f7.4,  a7) 

40  format  (lx,  a41,  al3,  fS.2,  a7) 

50  format  (lx,  a6,  gl0.3,  al5) 

60  format  (lx,  a43,  a9,  f5.2,  a4) 
end 

*  *  *  $  *  j|t  a|e  %  a|e3|e3|(3|e  **  $  $  *  #  *  *  jjc  *  *  *  *  **  sf;  *  *  *  *  *  *  *  *  *  *  Jfc  *  sfc  *  *  *  *  *  *  *  *  $  *  *  #  %  %  *  *  *  *  *  **  *  *  *  *  *  if:  *  *  *  * 


*  SUBROUTINE  POSPSI  * 

*  This  subroutine  outputs  the  data  necessary  to  plot  the  power  * 

*  spectral  density  of  the  quantization  noise  for  a  random  * 

*  sinusoidal  input  with  a  specified  autocorrelation.  This  data  * 

*  allows  the  plotting  of  the  power  spectral  density  versus  the  * 

*  horizontal  axis  of  frequency  in  increments  of  the  frequency  of  * 

*  the  random  sinusoidal  input.  * 


+  +  %  +  +  +  +  5f:***  +  *  +  +  +  5f:*  +  +  **  +  5t:i>  +  4:4:  +  **3|c  +  +  3f«  +  4:5f:3f;5|c  +  +  +  +  ****  +  +  +****  +  ***************5t: 


* 

Variables : 

* 

* 

q 

The  quantization  step  size 

* 

* 

a 

The  ampltitude  of  the  sinusoidal  input 

* 

* 

noofbt 

The  number  of  bits  used  in  the  quantization 

* 

* 

process 

* 

* 

aka 

The  array  which  stores  the  previosly  calculated 

* 

* 

a  sub  k’s 

* 

* 

b 

A  quantity  calculated  earlier  which  is  necessary 

* 

* 

to  provide  the  power  spectral  density  of  the 

* 

* 

quantization  noise 

* 

* 

psde 

The  error  power  spectral  density 

* 

* 

psdo 

The  output  power  spectral  density 

* 

* 

psdi 

The  input  power  spectral  density 

* 

♦ 

psdO 

A  value  set  to  zero  which  aids  in  the  plotting 

* 

* 

of  the  delta  functions 

* 

* 

indf 

An  index  used  to  iterate  through  freq’s 

* 

* 

freq 

The  frequency  in  increments  of  the  input 

* 

* 

frequency 

* 

* 

valid 

A  logical  indication  of  whether  the  qara  is  a 

* 

* 

valid  ratio 

* 

+  *  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  *  +  +  +  +  +  +  +  +  +  +  +  +  +  +  * 

subroutine  pospsi(q,a,noofbt) 

real  q,  a,  aka(0 : 10000) ,  b,  psde,  psdo,  psdi,  psdO 
integer  noofbt,  indf ,  freq 
logical  valid 

call  testra(q, a, noofbt, valid) 
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if  (valid)  then 

open  (unit=i6,file=’sinerr') 

open  (unit=17,file=’sinout') 

open  (unit=18,f ile=’sinin') 

call  dtaksi(q,a,noofbt,aka,b) 

psde  =  aka(O)  +  b 

psdo  =  aka(O) 

psdi  =  (a**2)/2. 

psdO  =  0. 

freq  =  1 

write(16,20)  freq,  psdO 
write(16,20)  freq,  psde 
write(16,20)  freq,  psdO 
write(17,20)  freq,  psdO 
write(17,20)  freq,  psdo 
write(17,20)  freq,  psdO 
write(18,20)  freq,  psdO 
write(18,20)  freq,  psdi 
write(18,20)  freq,  psdO 
do  10  indf  =  1,  20 

freq  =  2  *  indf  +  1 
psde  =  aka(indf) 
psdo  =  aka(indf) 
write(16,20)  freq,  psdO 
write(16,20)  freq,  psde 
write(16,20)  freq,  psdO 
write(l7,20)  freq,  psdO 
write(17,20)  freq,  psdo 
write(17,20)  freq,  psdO 
10  continue 

close  (unit=16) 
close  (unit=17) 
close  (unit=18) 
end  if 

20  format  (lx,  i3,  5x,  el2.5) 
end 

$  jfc  %  #  *  *  *  $  jfr  9|c  $$  sfc  *  +  $  >}c  +  %  ?|c  *  *  $  +  sfc  ^  •+■  +  jjc + *  $  $  *  +  *  +  *  *  *  $  $  $  $  $  jjcifc  $  +  jjc  *  + sfc  ifc  *  * * + jje  jJc  +  jfc  $  $  $  *  j|c 

*  SUBROUTINE  TESTRA  * 


*  This  subroutine  tests  the  given  ratio  of  the  quantization  step  * 

*  size  to  the  amplitude  of  the  random  sinusoidal  input  in  order  * 

*  to  determine  if  subsequent  calculations  are  valid.  * 

+  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  +  + 


*  Variables: 


* 


*  q  :  The  quantization  step  size  * 

*  a  :  The  ampltitude  of  the  sinusoidal  input  * 

*  noofbt  :  The  number  of  bits  used  in  the  quantization  * 

*  process  * 

*  valid  :  A  logical  indication  of  whether  the  qara  is  a  * 

*  valid  ratio  * 


*  qara  :  The  ratio  of  the  step  size  to  the  amplitude  of  * 
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* 

the  sinusoidal  input 

* 

* 

mrec 

The 

reciprocal  of  m 

* 

* 

Pi 

The 

usual  constant 

* 

* 

piov2 

The 

value  of  pi  divided  by  2 

* 

* 

ssum 

The 

iterated  sum  of  square  roots  used  as  a 

* 

* 

test  quantity 

* 

* 

coqty 

The 

qunatity  derived  from  ssum  which  is  compared 

* 

* 

to  piov2 

* 

* 

m 

The 

number  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non¬ 

* 

* 

zero  range 

* 

* 

ind 

An 

Index  used  in  the  process 

* 

************************************************************************ 
subrout ine  t  e  str a ( q , a , noof bt , val id ) 

real  q,  a,  qara,  mrec,  pi,  piov2,  ssum,  coqty 

integer  noofbt,  m,  ind 

logical  valid 

valid  =  .true. 

qara  =  q/a 

m  =  2** (noofbt  -  1)  -  1 
mrec  =  999999 
if  (m  .ne.  0)  mrec  =  l./m 
if  (qara  .gt.  mrec)  then 

write(6,*)  'The  q  to  A  ratio  is  too  large!' 
valid  =  .false. 

else 

pi  =  3.1416 
piov2  =  pi/2, 
ssum  =  0. 
do  10  ind  =  1,  m 

ssum  =  ssum  +  sqrt(l.  -  (ind  *  qara)**2) 

10  continue 

coqty  =  qara  *  (1+2.  *  ssum) 
if  (coqty  .It.  piov2)  then 

write(6,*)  'The  q  to  A  ratio  is  not  appropriate!' 
valid  =  .false, 
end  if 
end  if 

end 

******************************************************************** ***.1 

*  SUBROUTINE  DTAKSI  * 

************************************************************************ 

*  This  subroutine  determines  all  values  of  a  sub  k  for  k  =  0  * 

*  through  k  =  10,000.  It  also  produces  the  constant  b,  which,  * 

*  along  with  the  a  sub  k's,  is  necessary  to  determine  the  * 

*  quantization  noise  spectrum.  * 

************************************************************************ 

*  Variables :  * 


* 

aka 

:  The  array  which  ultimately  contains  all  of  the 

* 

* 

desired  a  sub  k’s 

* 

* 

qara 

:  The  ratio  of  the  step  size  to  the  amplitude  of 

* 

100 


* 

the  random  sinusoidal  input 

* 

* 

q  : 

The 

quantization  step  size 

* 

* 

m  : 

The 

number  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non- 

* 

* 

zero  range 

* 

* 

k  : 

The 

parameter  which  indicates  the  desired 

* 

* 

a  sub  k  prime 

* 

* 

valid  : 

A  logical  indication  of  whether  the  qara  is  a 

* 

* 

valid  ratio 

* 

************************************************************************ 

subroutine  dtaksi(q,a,nooibt ,aka,b) 

real  q,  a,  aka(0: 10000) ,  b,  pi,  qara,  sumex 

integer  noofbt, 

m,  k,  ind 

pi  =  3.1416 

qara  =  q/a 

m  =  2**(noofbt  • 

-  1)  -  1 

do  10  k  =  0 

,  10000 

call  claksi(aka(k) ,qara,m,k,q) 

10  continue 

sumex  =  0. 

do  20  ind  = 

1,  m 

sumex  = 

sumex  +  sqrt(a**2  -  (ind  *  q)**2) 

20  continue 

b  =  (a**2)/2.  - 

4.  *  q  *  (sumex  +  a/2.)/pi 

end 

Jit*************************************-?********************************* 

* 

SUBROUTINE  CLAKSI 

* 

************************************************** ********************** 

* 

This  subroutine 

calculates  the  exact  value  of  a  sub  k  for  k 

* 

* 

such  that  0  <=  ] 

k  <= 

10000.  Larger  values  of  k  will  result  in 

* 

* 

negligible  values. 

* 

************************************* *********************************** 

* 

Variables: 

* 

* 

ak  : 

The 

desired  value  a  sub  k 

* 

* 

qara  : 

The 

ratio  of  the  step  size  to  the  amplitude  of 

* 

* 

the  random  sinusoidal  input 

* 

* 

m  : 

The 

number  transitions  between  quantization 

* 

* 

levels  in  the  positive  (or  negative)  non- 

* 

* 

zero  range 

* 

* 

k  : 

The 

parameter  which  indicates  the  desired 

* 

* 

a  sub  k 

* 

* 

q  : 

The 

quantization  step  size 

* 

* 

pi  : 

The 

standard  constant 

* 

* 

ms  urn  : 

The 

total  evaluation  of  the  summation  term 

* 

* 

polarg  : 

The 

iterated  argument  of  the  Tchebycheff 

* 

* 

polynomial  in  the  summation  term  of  the 

* 

* 

appropriate  a  sub  k  equation 

* 

* 

polqty  : 

The 

iterated  evaluation  of  the  Tchebycheff 

* 

* 

polynomial  in  the  summation  term  of  the 

* 

* 

appropriate  a  sub  k  equation 

* 

* 

squqty  : 

The 

squared  quantity  which  includes  all  terms 

* 
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*  involving  Tchebycheff  polynomial  evaluations  * 

*  dukpll  :  The  value  corresponding  to  2k  +  1  * 

*  i  :  An  index  used  in  the  process  * 

********************************************************** ************** 

subroutine  claksi(ak,qara,m,k,q) 

real  ak,  qara,  q,  pi,  msum,  polarg,  polqty,  squqty 

integer  m,  k,  dukpll,  i 

pi  =  3.1416 

dukpll  =  2  *  k  +  1 

msum  =  0. 

do  10  i  =  1,  m 

polarg  =  i  *  qara 
call  evuk(dukpll .polarg, polqty) 
msum  =  msum  +  polqty 
10  continue 

polarg  =  0. 

call  evuk(dukpll, polarg, polqty) 

squqty  =  (polqty  +  2.  *  msum)**2 

ak  =  2.  *  ((q/(pi  *  dukpll) )**2)  *  squqty 

end 

************************************** ********************************** 

*  SUBROUTINE  EVUK  * 

************************************************************************ 

* 

* 

* 


This  subroutine  evaluated  the  Tchebycheff  polynomial  of  the  * 
second  kind,  U  sub  k  of  the  argument,  given  the  argument  and  * 
the  degree,  k,  of  the  polynomial.  * 

************************************************************************ 


Variables: 

k 


:  The  parameter  which  indicates  the  desired 

a  sub  k 

polarg  :  The  argument  of  the  polynomial 
polqty  :  The  evaluation  of  the  polynomial  for  the 
argument 

************************************************************************ 
subroutine  evuk(k, polarg, polqty) 
real  polarg,  polqty 
integer  k 

polqty  =  sin(k  *  acos (polarg)) 
end 
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